Created a site indexing tool to scrape web content and batch upload the indexed docs into AWS Cloudsearch. The system handles automated indexing and uploading to the Cloud system allowing the AWS Cloudsearch tool to return most accurate search results for the public facing site. The system also allows complete control over what urls are indexed and also provides realtime diagnostics for system links, missing content, and site health. The system was built using PHP, Mysql and JS.
