Modified apache-config and robots.txt

The AWS containers were misconfigured so that every robot
imaginable was able to scrape download whatever they wanted.
Pumping the brakes on that and will see what happens.
2 jobs for db_backend_test in 12 minutes and 39 seconds (queued for 1 second)
Status Job ID Name Coverage
  Test
passed test:3.7 #1397834

00:06:38

73.0%
 
  Branch
passed branch_image #1397835

00:06:00