tub4us.top
robots.txt

Robots Exclusion Standard data for tub4us.top

Resource Scan

Scan Details

Site Domain tub4us.top
Base Domain tub4us.top
Scan Status Ok
Last Scan5/14/2025, 11:03:44 PM
Next Scan 6/13/2025, 11:03:44 PM

Last Scan

Scanned5/14/2025, 11:03:44 PM
URL https://www.tub4us.top/robots.txt
Domain IPs 104.21.60.213, 172.67.201.201, 2606:4700:3032::6815:3cd5, 2606:4700:3032::ac43:c9c9
Response IP 104.21.60.213
Found Yes
Hash 8ef57c034a3da245f46d7119d6b08d48ce299c43cc6c203130e492c7d9f31277
SimHash 6d9e9c5077c4

Groups

googlebot

Rule Path
Disallow /tag*
Disallow /reembed/
Disallow /index.php*

Other Records

Field Value
crawl-delay 40

bingbot

Rule Path
Disallow /tag*
Disallow /reembed/
Disallow /index.php*

Other Records

Field Value
crawl-delay 1

*

Rule Path
Disallow /tag*
Disallow /reembed/
Disallow /index.php*

Other Records

Field Value
crawl-delay 60