Log In Sign Up

allthetests.com
robots.txt

Robots Exclusion Standard data for allthetests.com

Resource Scan

Scan Details

Site Domain allthetests.com
Base Domain allthetests.com
Scan Status Ok
Last Scan2024-06-05T13:39:07+00:00
Next Scan 2024-06-12T13:39:07+00:00

Last Scan

Scanned2024-06-05T13:39:07+00:00
URL https://allthetests.com/robots.txt
Redirect https://www.allthetests.com/robots.txt
Redirect Domain www.allthetests.com
Redirect Base allthetests.com
Domain IPs 67.225.220.11
Redirect IPs 67.225.220.11
Response IP 67.225.220.11
Found Yes
Hash a6be43ec2cbabac92a105535fc995c29952ea1297d2c7d05f0cb06dda3745a7f
SimHash eae4414044b4

Groups

*

Rule Path
Disallow /privacy.php

ccbot
google-extended
gptbot
chatgpt-user
omgilibot
omgili
facebookbot
anthropic-ai
cohere-ai

Rule Path
Disallow /

googlebot

Rule Path
Disallow

adsbot-google

Rule Path
Disallow

googlebot-image

Rule Path
Disallow
Back to top

Other Records

Field Value
sitemap https://www.allthetests.com/sitemap.xml
Back to top

Comments

  • Disallow: /widget.php
  • Disallow: /illegaltest.php
  • Disallow: /newstickeronhpalg.php3
  • Disallow: /quiz*/code.php
  • Disallow: /quiz*/quizerstellung3pu.php
  • Disallow: /quiz*/mailtocreater.php
  • Disallow: /quiz*/showquizstat.php
  • Disallow: /quiz*/flash.php
  • Disallow: /recommender.php3
  • Disallow: /yourquiz.php
  • Disallow: /quiz*/dasquiz2.php3
  • Disallow: /livesearch/livesearch_script/livesearch.php
  • Disallow: /*utm_source*
  • Disallow: /*utm_medium*
  • Disallow: /*utm_campaign*
  • Disallow: /*sortby!bewertung*
  • Disallow: /*sortby=*
  • Disallow: /*comments_page=*
  • Disallow: /*antwortEinzelnja=*
  • Disallow: /*pflegeja=*
  • Disallow: /*PageSpeed=*
  • Disallow: /*ved=*
  • Disallow: /*usg=*
  • Disallow: /*newsurl=*
  • Disallow: /*ModPagespeed=*
  • Disallow: /*katname=*
  • Disallow: /*erstellemail=*
  • das block die AI Robots
  • das erlaubt alles
Back to top