german--porn.com
robots.txt

Robots Exclusion Standard data for german--porn.com

Resource Scan

Scan Details

Site Domain german--porn.com
Base Domain german--porn.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2025-12-14T21:25:12+00:00
Next Scan 2026-03-14T21:25:12+00:00

Last Successful Scan

Scanned2025-01-26T19:57:29+00:00
URL https://german--porn.com/robots.txt
Domain IPs 104.21.76.34, 172.67.186.71, 2606:4700:3033::6815:4c22, 2606:4700:3035::ac43:ba47
Response IP 172.67.186.71
Found Yes
Hash ddbcb938200df63d6458db9baa98ce8bbbb6897bf332d8f775e5361253eb0391
SimHash 6950dc514711

Groups

*

Rule Path
Allow /

Other Records

Field Value
crawl-delay 10

Other Records

Field Value
sitemap http://german--porn.com/sitemap.xml.gz