theworldpursuit.com
robots.txt

Robots Exclusion Standard data for theworldpursuit.com

Resource Scan

Scan Details

Site Domain theworldpursuit.com
Base Domain theworldpursuit.com
Scan Status Ok
Last Scan2024-06-22T05:45:08+00:00
Next Scan 2024-06-29T05:45:08+00:00

Last Scan

Scanned2024-06-22T05:45:08+00:00
URL https://theworldpursuit.com/robots.txt
Domain IPs 104.18.37.69, 172.64.150.187, 2606:4700:4400::6812:2545, 2606:4700:4400::ac40:96bb
Response IP 104.18.37.69
Found Yes
Hash 6b424840f0fb9482e51e887be677fc2ade8c9b570698f4406306fb8803116f2f
SimHash e2148842eb33

Groups

ahrefsbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

xenu

Rule Path
Disallow /

moget

Rule Path
Disallow /

ichiro

Rule Path
Disallow /

naverbot

Rule Path
Disallow /

yeti

Rule Path
Disallow /

spbot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

*

Rule Path
Allow /wp-admin/admin-ajax.php

Other Records

Field Value
sitemap https://theworldpursuit.com/sitemap_index.xml