worldlistmania.com
robots.txt

Robots Exclusion Standard data for worldlistmania.com

Resource Scan

Scan Details

Site Domain worldlistmania.com
Base Domain worldlistmania.com
Scan Status Ok
Last Scan2024-06-24T18:14:10+00:00
Next Scan 2024-07-01T18:14:10+00:00

Last Scan

Scanned2024-06-24T18:14:10+00:00
URL https://worldlistmania.com/robots.txt
Redirect https://www.worldlistmania.com/robots.txt
Redirect Domain www.worldlistmania.com
Redirect Base worldlistmania.com
Domain IPs 104.21.16.16, 172.67.209.197, 2606:4700:3033::ac43:d1c5, 2606:4700:3036::6815:1010
Redirect IPs 104.21.16.16, 172.67.209.197, 2606:4700:3033::ac43:d1c5, 2606:4700:3036::6815:1010
Response IP 172.67.209.197
Found Yes
Hash fccd3e4f23869305ce48e50849696cd0fbfef0316af7ecff12fc72c37c1bca37
SimHash 6d2949a6ca13

Groups

*

Rule Path
Disallow /cgi-bin/
Disallow /wp-admin/
Disallow /linkout/
Disallow /recommended/
Disallow /comments/feed/
Disallow /trackback/
Disallow /index.php
Disallow /xmlrpc.php

ninjabot

Rule Path
Allow /

mediapartners-google*

Rule Path
Allow /

googlebot-image

Rule Path
Allow /wp-content/uploads/

adsbot-google

Rule Path
Allow /

googlebot-mobile

Rule Path
Allow /

googlebot

Rule Path
Disallow

amazonbot

Rule Path
Disallow

qualys

Rule Path
Disallow

synthetic bot

Rule Path
Disallow

bingbot

Rule Path
Disallow

clickagy

Rule Path
Disallow

yandexbot

Rule Path
Disallow

google adsbot

Rule Path
Disallow

google image proxy

Rule Path
Disallow

googleother

Rule Path
Disallow

gptbot

Rule Path
Disallow

ahrefsbot

Rule Path
Disallow

google api

Rule Path
Disallow

google images

Rule Path
Disallow

detectify

Rule Path
Disallow

new relic

Rule Path
Disallow

petalbot

Rule Path
Disallow

uptimerobot

Rule Path
Disallow

applebot

Rule Path
Disallow

sendgrid

Rule Path
Disallow

Other Records

Field Value
sitemap https://www.worldlistmania.com/sitemap_index.xml

Comments

  • START YOAST BLOCK
  • ---------------------------
  • ---------------------------
  • END YOAST BLOCK