Build your own search engine #62
Description
What?
https://boyter.org/2013/01/code-for-a-search-engine-in-php-part-1/ in Rust
Why?
To learn about Rust idioms, performance, async, ...
How?
Plot twist: It's not a normal search engine for today's web, but one for the past.
Today's websites are expensive to crawl thanks to big file sizes and a lot of JS.
Instead, get the top 1 million websites from 2000 and crawl them through archive.org. 😉