B2C comparison platform
Technology comparison platform
Built and hardened a public comparison platform for technology products, with a dedicated crawler, structured catalogue pages and a separate management environment.
Situation
The project needed to move from an internal data-collection and staging setup into a stable public-facing comparison service, with safer affiliate routing, environment separation and ongoing catalogue refreshes.
Technical work
- Built and operated a crawler pipeline for public product, offer, price and image data.
- Normalised catalogue data around stable identifiers where available and structured public search, product, category and brand pages.
- Added canonical product/category URLs, hierarchical taxonomy handling and price-history display.
- Routed outbound merchant links through opaque tokens instead of exposing raw offer identifiers.
- Separated public production, staging and internal management environments.
- Added SEO controls, sitemap filtering, noindex handling and scheduled refresh/publishing jobs.
- Built management views for catalogue review, crawler status, statistics and editorial publishing.
Outcome
Reduced operational risk, improved maintainability and made support easier through clearer crawler, publishing, management and deployment workflows.