waytohey.com
robots.txt

Robots Exclusion Standard data for waytohey.com

Resource Scan

Scan Details

Site Domain waytohey.com
Base Domain waytohey.com
Scan Status Ok
Last Scan2024-09-24T12:22:01+00:00
Next Scan 2024-10-01T12:22:01+00:00

Last Scan

Scanned2024-09-24T12:22:01+00:00
URL https://waytohey.com/robots.txt
Domain IPs 195.201.196.236, 2a01:4f8:13a:1c9c::2, 2a01:4f8:13b:30f1::2, 94.130.139.11
Response IP 195.201.196.236
Found Yes
Hash 8d66842333e0070f59251fde826364f2552e02ccbeb25aefc5f37f52adc29d39
SimHash 70749002d4b0

Groups

*

Rule Path
Allow /$
Allow /articles/*
Allow /sitemap*
Allow /8791626346722epsSGrB-WXmFRRFf0FZQKAN7MPIf6BY9.txt$
Allow /ads.txt$
Allow /googlebb185ae9e5565349.html$
Allow /w1_184774128548.txt$
Allow /dating*
Allow /s/*
Allow /f/*
Disallow /

mediapartners-google

Rule Path
Disallow /redirect/
Disallow /login/
Disallow /oauth/
Disallow /confirm/
Allow /

mj12bot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

twitterbot

Rule Path
Disallow /redirect/
Disallow /login/
Disallow /oauth/
Disallow /confirm/
Allow /

Other Records

Field Value
sitemap https://waytohey.com/sitemap.xml