gotporn.me
robots.txt

Robots Exclusion Standard data for gotporn.me

Resource Scan

Scan Details

Site Domain gotporn.me
Base Domain gotporn.me
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a server error.
Last Scan2024-07-08T21:43:19+00:00
Next Scan 2024-10-06T21:43:19+00:00

Last Successful Scan

Scanned2023-02-22T21:40:43+00:00
URL https://gotporn.me/robots.txt
Redirect https://gotporn.pro/robots.txt
Redirect Domain gotporn.pro
Redirect Base gotporn.pro
Domain IPs 104.21.31.105, 172.67.176.55, 2606:4700:3033::6815:1f69, 2606:4700:3036::ac43:b037
Redirect IPs 104.21.96.70, 172.67.174.2, 2606:4700:3030::ac43:ae02, 2606:4700:3036::6815:6046
Response IP 104.21.96.70
Found Yes
Hash 37457dc2ee4b47b0bc443f457f937a78c7603ec6b35a7ca31fd986f169305cf6
SimHash 4709c841c3b6

Groups

yandex

Rule Path
Disallow /archive/*

Other Records

Field Value
crawl-delay 2.0

bingbot

Rule Path
Disallow /archive/*

Other Records

Field Value
crawl-delay 5

*

Rule Path
Disallow /archive/*

Other Records

Field Value
sitemap https://gotporn.pro/sitemap.xml

Warnings

  • `host` is not a known field.