de.tub4us.top
robots.txt

Robots Exclusion Standard data for de.tub4us.top

Resource Scan

Scan Details

Site Domain de.tub4us.top
Base Domain tub4us.top
Scan Status Ok
Last Scan5/20/2025, 10:55:49 PM
Next Scan 6/19/2025, 10:55:49 PM

Last Scan

Scanned5/20/2025, 10:55:49 PM
URL https://de.tub4us.top/robots.txt
Domain IPs 104.21.60.213, 172.67.201.201, 2606:4700:3032::6815:3cd5, 2606:4700:3032::ac43:c9c9
Response IP 172.67.201.201
Found Yes
Hash 8ef57c034a3da245f46d7119d6b08d48ce299c43cc6c203130e492c7d9f31277
SimHash 6d9e9c5077c4

Groups

googlebot

Rule Path
Disallow /tag*
Disallow /reembed/
Disallow /index.php*

Other Records

Field Value
crawl-delay 40

bingbot

Rule Path
Disallow /tag*
Disallow /reembed/
Disallow /index.php*

Other Records

Field Value
crawl-delay 1

*

Rule Path
Disallow /tag*
Disallow /reembed/
Disallow /index.php*

Other Records

Field Value
crawl-delay 60