tacomaworld.com
robots.txt

Robots Exclusion Standard data for tacomaworld.com

Resource Scan

Scan Details

Site Domain tacomaworld.com
Base Domain tacomaworld.com
Scan Status Ok
Last Scan2024-09-23T14:55:48+00:00
Next Scan 2024-09-30T14:55:48+00:00

Last Scan

Scanned2024-09-23T14:55:48+00:00
URL https://tacomaworld.com/robots.txt
Redirect https://www.tacomaworld.com/robots.txt
Redirect Domain www.tacomaworld.com
Redirect Base tacomaworld.com
Domain IPs 165.227.54.111
Redirect IPs 165.227.54.111
Response IP 165.227.54.111
Found Yes
Hash 1d91c8231dc42c9a99bd096a2336a8fe2e73c59205628be34df2bc0d3143a5a6
SimHash d81c50c7bb48

Groups

ia_archiver

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

grapeshot

Rule Path
Disallow /

ias-va

Rule Path
Disallow /

magpie-crawler

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

proximic

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

semrushbot-ba

Rule Path
Disallow /

semrushbot-si

Rule Path
Disallow /

sogou web spider

Rule Path
Disallow /

ttd-content

Rule Path
Disallow /

*

Rule Path
Disallow /p/
Disallow /find-new/
Disallow /help/
Disallow /members/
Disallow /online/
Disallow /search/
Disallow /threads/*.5333/
Disallow /threads/*.145576/
Disallow /threads/*.334723/
Disallow /threads/*.26810/

Other Records

Field Value
sitemap https://www.tacomaworld.com/sitemap.php