{"success":true,"meta":{"author":"Rajat Surana","portfolio":"https://rajatsurana.is-a.dev","github":"https://github.com/rajatsurana19","self":"https://rajatsurana.is-a.dev/api/projects/rs-engine","allProjectsEndpoint":"https://rajatsurana.is-a.dev/api/projects"},"project":{"id":"rs-engine","slug":"rs-engine","title":"RS-Engine","subtitle":"Custom Search Engine & Web Crawler From Scratch","category":"Systems & Tools","tech":["Python","Flask","Multi-Threading","Inverted Index","TF-IDF","HTML5"],"summary":"Built a complete web search engine from scratch with a concurrent crawler, inverted indexing pipeline, and TF-IDF relevance ranking.","description":"Engineered an information retrieval system from fundamental computer science principles. Implemented a concurrent, multi-threaded web crawler with URL frontier management and politeness delays, an indexing engine that tokenizes documents and eliminates stopwords, and a vector space TF-IDF scoring algorithm that ranks web pages against search queries with a Google-inspired Flask web UI.","features":["Concurrent multi-threaded crawler with domain throttling and depth limits","Inverted index data structure mapping tokens to document posting lists with term frequencies","TF-IDF relevance algorithm scoring cosine similarity between query and documents","Tokenization, lowercasing, punctuation stripping, and stopword removal pipeline","Clean, responsive Flask web application for query execution and result previewing"],"contributions":["Built custom inverted index serialization and fast in-memory posting list lookups","Implemented thread-safe visited URL sets to prevent crawling cycles","Optimized score computation using sparse term frequency vectors"],"metrics":["Custom TF-IDF ranking","Multi-threaded crawler","Zero external search libraries"],"links":{"github":"https://github.com/rajatsurana19/rs-engine","live":null,"apiEndpoint":"https://rajatsurana.is-a.dev/api/projects/rs-engine"},"image":"/project/rsengine.svg","highlight":false,"featured":false}}