dealscape.thedeal.com
robots.txt

Robots Exclusion Standard data for dealscape.thedeal.com

Resource Scan

Scan Details

Site Domain dealscape.thedeal.com
Base Domain thedeal.com
Scan Status Ok
Last Scan2024-10-02T21:12:47+00:00
Next Scan 2024-11-01T21:12:47+00:00

Last Scan

Scanned2024-10-02T21:12:47+00:00
URL https://dealscape.thedeal.com/robots.txt
Redirect https://www.thedeal.com/robots.txt
Redirect Domain www.thedeal.com
Redirect Base thedeal.com
Domain IPs 34.198.121.31, 52.206.138.179
Redirect IPs 141.193.213.20, 141.193.213.21
Response IP 141.193.213.20
Found Yes
Hash 1c87f212483a0d26e29e5830305024d6cd5695ee74a6daabca72a1e00d062277
SimHash c861e0802726

Groups

*

Rule Path
Disallow /wp-admin/
Disallow /marketing/
Disallow *.pdf$
Disallow /images/pdf/
Disallow /tdp/
Disallow /pdf/
Disallow /knowledge/
Disallow /tag/
Allow /wp-admin/admin-ajax.php