Jobs Classification & Search
Collect and classify job descriptions at scale, then make them searchable.
- Role
- Backend / data engineer
- Year
- 2020
- Timeline
- Research + delivery
Job descriptions were scattered across many sites in inconsistent formats, with no unified way to categorise or search them.
Collection had to be fast and parallel across many sources, and the messy text had to be cleaned before it could be classified or searched usefully.
Built parallel scrapers feeding a clean NLP + Elasticsearch pipeline.
Instead of Sequential scraping into a plain database.
Why: Multithreaded/multiprocessing collection plus a proper search index turned a slow scrape into a searchable, categorised dataset.
- Multithreaded / multiprocessing scrapers
- NLP categorisation by location, skills & experience
- Cleaning & preprocessing pipeline
- Elasticsearch search over the corpus
Hemant Manglani
Ahmedabad, India
Looking for someone who ships? Let’s talk.
I’m actively looking for a backend or AI engineering role. If your team needs an engineer who can own systems end to end, I’d love to hear about it.
Actively looking · Ahmedabad · on-site, hybrid or remote