edate.com
robots.txt

Robots Exclusion Standard data for edate.com

Resource Scan

Scan Details

Site Domain edate.com
Base Domain edate.com
Scan Status Ok
Last Scan2024-06-13T09:41:17+00:00
Next Scan 2024-06-20T09:41:17+00:00

Last Scan

Scanned2024-06-13T09:41:17+00:00
URL https://edate.com/robots.txt
Redirect https://www.edate.com/robots.txt
Redirect Domain www.edate.com
Redirect Base edate.com
Domain IPs 3.227.215.221, 3.82.91.15
Redirect IPs 3.227.215.221, 3.82.91.15
Response IP 3.227.215.221
Found Yes
Hash f3d5ecca338a5312afd10d877b7c8849d6cf5379b0fa6da46025310840740eca
SimHash c28e5c00c40f

Groups

*

Rule Path
Disallow /nw/index
Disallow /ad/
Disallow /edate/
Disallow /admin/
Disallow /affiliates/
Disallow /ambassadors/
Disallow /c/
Disallow /cj/
Disallow /cj2/
Disallow /crtv/
Disallow /cj2/
Disallow /cj2/
Disallow /cupid/
Disallow /email/
Disallow /errors/
Disallow /galleries/
Disallow /images/
Disallow /js/
Disallow /matecall/
Disallow /oa/
Disallow /opt/
Disallow /p3p/
Disallow /popups/
Disallow /print/
Disallow /rd/
Disallow /rdkw/
Disallow /scripts/
Disallow /stats/
Disallow /tgp/
Disallow /api/
Disallow /nw/

Other Records

Field Value
crawl-delay 30

baiduspider
baiduspider-video
baiduspider-image
youdaobot
sogou spider
yandex
baiduspider+
mj12bot
clickagy intelligence bot

Rule Path
Disallow /

clickagy intelligence bot v2

Rule Path
Disallow /

clickagy

Rule Path
Disallow /

Other Records

Field Value
sitemap https://cdn.edate.com/sitemaps/sitemap.xml.gz