dealsalecode.com
robots.txt

Robots Exclusion Standard data for dealsalecode.com

Resource Scan

Scan Details

Site Domain dealsalecode.com
Base Domain dealsalecode.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a server error.
Last Scan2025-11-03T09:02:51+00:00
Next Scan 2026-02-01T09:02:51+00:00

Last Successful Scan

Scanned2025-04-07T02:18:49+00:00
URL https://dealsalecode.com/robots.txt
Redirect https://www.dealsalecode.com/robots.txt
Redirect Domain www.dealsalecode.com
Redirect Base dealsalecode.com
Domain IPs 104.21.4.106, 172.67.131.253, 2606:4700:3033::ac43:83fd, 2606:4700:3036::6815:46a
Redirect IPs 104.21.4.106, 172.67.131.253, 2606:4700:3033::ac43:83fd, 2606:4700:3036::6815:46a
Response IP 104.21.4.106
Found Yes
Hash b68fc8c6fdc11b33183b0e44d6d5d047d1a712a3bc178a1bd4519ad4c2a1d832
SimHash 6d34d6f2f852

Groups

mediapartners-google

Rule Path
Disallow

*

Rule Path
Disallow /editor/
Disallow /admin/
Disallow /crontab/
Disallow /backend/
Disallow /app/
Disallow /front/
Disallow /api/
Disallow /cdn-cgi/
Disallow /wp-content/
Disallow /go-*.html*
Disallow /go/
Disallow /search
Disallow /verify_robots
Disallow /rss-*.xml
Disallow /rsslist/
Disallow /front/
Disallow /websetting/*
Disallow /*?*sort=
Disallow /image-chirashi/
Disallow /impr/*
Disallow /click/*
Disallow /*?promoid=*

dotbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

mauibot

Rule Path
Disallow /

Warnings

  • 2 invalid lines.