Crawling Time Increasing Over Time (| ✓ | ⏱: 127.83s Even for Simple Pages)

[dvirginz]

Hi team,

I’ve noticed that recently the crawling process with Crawl4AI takes quite a bit longer than it used to — even for very simple pages. For example, a crawl now reports | ✓ | ⏱: 127.83s, which feels unusually slow.

I completely understand that this likely has nothing to do directly with Crawl4AI itself, but I wanted to ask if you have any idea what could cause this kind of slowdown? Maybe something like caching issues, resource piling up over time, or anything else I should check?

It wasn’t like this when I started using it, so I’m trying to figure out what could have changed.

Thanks in advance!