oid-base.com
robots.txt

Robots Exclusion Standard data for oid-base.com

Resource Scan

Scan Details

Site Domain oid-base.com
Base Domain oid-base.com
Scan Status Ok
Last Scan2025-08-12T05:38:33+00:00
Next Scan 2025-08-26T05:38:33+00:00

Last Scan

Scanned2025-08-12T05:38:33+00:00
URL https://oid-base.com/robots.txt
Domain IPs 2001:1af8:4900:a012:2::1337, 212.32.236.132
Response IP 212.32.236.132
Found Yes
Hash 30e117740312834aad7d970af802de2e25ad04aca2fdc3a8c9b23147658155c5
SimHash 692d3d604795

Groups

www.deadlinkchecker.com

Rule Path
Disallow /cgi-bin/
Disallow /get/

gptbot

Rule Path
Allow /llms.txt

*

Rule Path
Disallow /cgi-bin/$
Disallow /cgi-bin/display?tree=
Disallow /cgi-bin/display?a=density
Disallow /cgi-bin/manage?
Disallow /helper

Other Records

Field Value
sitemap https://oid-base.com/sitemap.xml