foros.plangeneralcontable.com
robots.txt

Robots Exclusion Standard data for foros.plangeneralcontable.com

Resource Scan

Scan Details

Site Domain foros.plangeneralcontable.com
Base Domain plangeneralcontable.com
Scan Status Ok
Last Scan2026-01-13T10:17:08+00:00
Next Scan 2026-02-12T10:17:08+00:00

Last Scan

Scanned2026-01-13T10:17:08+00:00
URL https://foros.plangeneralcontable.com/robots.txt
Domain IPs 51.178.59.115
Response IP 51.178.59.115
Found Yes
Hash 91f8fe1cb0ccd8ba1c3f90ed29f4ac2b2d2c0729ef8de264ecda4e08d8efab80
SimHash 731e5cc2ee2b

Groups

*

Rule Path
Disallow /memberlist.php
Disallow /ucp.php
Disallow /posting.php
Disallow /cache/
Disallow /includes/
Disallow /ext/
Disallow /store/

Other Records

Field Value
crawl-delay 5

serpstatbot

Rule Path
Disallow /

meta-externalagent

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

awariorssbot
awariosmartbot

Rule Path
Disallow /

spbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

rogerbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

claude-web

Rule Path
Disallow /

sirdatabot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

webcrawler

Rule Path
Disallow /

teleport

Rule Path
Disallow /

teleportpro

Rule Path
Disallow /

webstripper

Rule Path
Disallow /

webcopier*

Rule Path
Disallow /

webcapture

Rule Path
Disallow /

webreaper

Rule Path
Disallow /

webzip*

Rule Path
Disallow /

getleft

Rule Path
Disallow /

httrack

Rule Path
Disallow /

web downloader

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

Warnings

  • 1 invalid line.