I just created a bluesky account for crwlr => bsky.app/profile/crwlr.bsky.…
See you there! 🙂👋
26
PHP 8.4 just dropped! 🥳🚀💪
php.net/releases/8.4/en.php
Great release page! Well done!
Already added running tests on 8.4 in CI, so all crwlr packages should be ready for the upgrade! 💪🙂
crwlr.software retweeted
Trying PHP 8.4 for the first time today. Already love the new DOM features. Especially natively having CSS Selectors ☺️🫶
I'll also immediately start to make all @crwlrsoft packages fit for PHP 8.4! 💪
Package installs are slowly but steadily increasing.
Reached some milestones:
* 40.000 => crwlr/url
* 10.000 => crwlr/robots-txt
* 6.000 => crwlr/crawler
💪🏻
2
34
Shipped two bugfix releases yesterday and today:
github.com/crwlrsoft/crawler…
Thx to Viktor for the PR!
This marks the 26th release this year!
Also: nice number of github stars! 🤩😅
34
Already added the first new feature in v2:
Post browser navigate hooks.
When using the headless browser for loading, you can now interact with the browser after a page was loaded, before reading the state of the HTML source.
crwlr.software/packages/craw…
🚀💪
It’s release day! 🥳 v2.0 of the crawler package is finally out! 🚀💪🏻
A lot of work went into removing deprecated 1.x features. Now we can focus on new features and improvements again!
Check out the detailed upgrade guide here: crwlr.software/packages/craw…
We just reached 5,000 installs of the crwlr/crawler package! 🥳🚀
Super excited for the next 5,000 - this time, we’ll get there a lot faster! 💪🏻
Also: v2.0 is just around the corner! Stay tuned! 👀
crwlr.software retweeted
Breve tutorial para el uso de generators en php (ingles) #php
crwlr.software/blog/php-gene…
Yay 🥳 the crawler package is in fourth place for the topic web-crawling on github! 🦾🚀
github.com/topics/web-crawli…
crwlr/crawler v1.10 is out:
github.com/crwlrsoft/crawler…
Documentation is upgraded:
crwlr.software/packages/craw…
It's most likely the last minor version before 2.0!
💪🚀
Just upgraded the docs for the latest version (1.9) of the crawler package. The page about loaders got a major revamp.
crwlr.software/packages/craw…
1
39
Also there is a new feature in the browser extension package: you can combine the HTTP crawl step with the Screenshot step. This means you can crawl a full website (or parts) and take screenshots of all pages.
crwlr.software/packages/craw…
Yay 🥳🍾 we just made it to 💯 stars ⭐️ on github with the url package! 🤩 Thanks everyone for the support! 🙏🏻
If you haven't checked it out yet: it's like a swiss army knife for dealing with URLs!
crwlr.software/packages/url/…
Hey Twitter 👋 Please help, I'm just one star ⭐️ away from 💯 on my url package on github! 😅🙏
It’s pretty useful: it extracts the registrable domain, parses internationalized domain names, and more!
Check it out: github.com/crwlrsoft/url
1
48
crwlr.software retweeted
Since the crwlr library uses Generators to minimize memory usage and you also need them when writing custom steps, I’ve written a Quickstart Tutorial. 🤓✍️📗
If you’re new to Generators, check it out - it’s a very useful PHP feature in some situations.
crwlr.software/blog/php-gene…
Great news! v1.8 of the crawler package is out now! 🥳🚀
This release brings improved functionality for composing crawling result data, leading to better performance, minimized memory usage, and a more intuitive user experience. Read more: crwlr.software/blog/crawler-…
Time for a little celebration, the crwlr project reached some milestones!
The crawler package finally got 300 stars on github and url is close to 100 and also just crossed 30000 installs. Thanks to bref, the query-string package already crossed a million installs 🤯
And also the crwlr.software website is doing better and better in the google search 🥳
Thanks to everyone using the packages! 🙂🫶
27
Working hard to improve the crawler library! Already 11 releases this year! 💪🚀
github.com/crwlrsoft/crawler…
Also had an idea for a bigger change recently, that could make it a lot easier to use. It's about composing results which a lot of people find very complicated.







