Crawlee

Crawlee

Crawlee helps you build reliable crawlers, fast

Crawlee is an intuitive, customizable open-source library for web scraping and browser automation. Quickly scrape data, store it, and avoid getting blocked with auto-generated human-like fingerprints, headless browsers, and smart proxy rotation.

You might also like

A command-line interface productivity tool for developers powered by OpenAI's text-davinci-003, will help you accomplish your tasks faster and more efficiently. Forget about cheat sheets and notes, with this tool you can get answers right in your terminal.
Monkeytype is a minimalistic typing test, featuring many test modes, an account system to save your typing speed history and user configurable features like themes, a smooth caret and more.
Reddit subreddits recommender based 150+ million comments.
Depot is a hosted container build service that builds Docker images up to 20x faster than existing CI providers. We run fully managed Intel and Arm builders in AWS, accessible directly from CI and from your terminal.
What if ChatGPT knew all your content? CustomGPT lets you "Build Your Own ChatBOT" with your own data. Using OpenAI's language models, this chatbot lets you write blog posts, answer customer service questions, plus 100+ use cases.
How can the other largest online retailer get a better position for popular keywords? Their secret solution is Programmatic SEO, they are programmatically generating special content for each keyword. Programmatico helps you find the longtail keywords for your SEO Strateg…
👋 Hi, Meet Hoppscotch — an open sourced API request builder. Helps you create requests faster, saving precious time on development.
When I write, I often get stuck. It's a painful experience. With Lex, now I just type "+++" and AI will suggest what might come next. It can also generate headline ideas. The AI quality is mind-blowing!
Regular expression tester with syntax highlighting, explanation, cheat sheet for PHP/PCRE, Python, GO, JavaScript, Java, C#/.NET.
Azgaar's Fantasy Map Generator is a free open source tool that allows users to create and edit fantasy maps. It is designed for fantasy writers, game masters, and cartographers. Users can generate maps, customize them, and use them for their projects. The tool is under active de…
Forget yet another BI tool. Build fully automated dashboards with the flexibility and familiarity of a spreadsheet. With native connections to your data, Equals automatically updates your charts and tables as needed, so you never have to.
Help Apple design the next iPhone before the September event.
Giving away your real email address when using the Internet is not always the best choice, Get your temporary email for free in just seconds. 🔒 Fully encrypted 😎 Anonymous 🚀 Unlimited and free
Start tracking your habits with the 2024 Habit Calendar. It's compact, foldable, and customizable to your needs. Don't just plan your year, make it a habit!
Ship code faster with Graphite. Stay unblocked on code review with “stacking” - the workflow engineers at top companies use to accelerate their development. Now available to anyone with a GitHub account.
Click on a match to show a play-by-play view, and view live score updates! The current (or most recent) game appears at the top of your screen. Once the group games are done, scroll down to see an entire tournament bracket also updated in real time.
Meet Bard: your creative and helpful collaborator, here to supercharge your imagination, boost your productivity, and bring your ideas to life.
Your new home for exploring movies and tv shows. 🍿 Curated & beautifully designed home page for new and upcoming releases 📊 Create stats like your top rated directors, actors & more. ❤️ Connect with your friends and see which titles they like.
With Florida man headlines being so unreal and logic-defying, can you reliably distinguish between a real headline and something that's just made up? Find out now.
Typst is a collaborative app for scientific writing. You focus on your text, Typst takes care of the rest. Automatic templates make formatting a breeze. And with tightly integrated markup and layout, your document looks exactly like you imagine it.