methodistnomads.org
robots.txt

Robots Exclusion Standard data for methodistnomads.org

Resource Scan

Scan Details

Site Domain methodistnomads.org
Base Domain methodistnomads.org
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-11-01T08:01:04+00:00
Next Scan 2025-12-31T08:01:04+00:00

Last Successful Scan

Scanned2025-08-10T17:34:13+00:00
URL https://www.methodistnomads.org/robots.txt
Domain IPs 13.84.31.161
Response IP 13.84.31.161
Found Yes
Hash de38b702eb5c356a41b9fb619ed37f94d9911467dc716f4dd55033d4988a6be7
SimHash e21fdc11c493

Groups

bingbot
googlebot
addsearchbot
facebookbot
facebookexternalhit
linkedinbot
applebot
slurp
duckduckbot
web-site-map
ia_archiver

Rule Path
Disallow

*

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

fidget-spinner-bot

Rule Path
Disallow /

thesis-research-bot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.methodistnomads.org/sitemap.xml