promocodes.com
robots.txt

Robots Exclusion Standard data for promocodes.com

Resource Scan

Scan Details

Site Domain promocodes.com
Base Domain promocodes.com
Scan Status Ok
Last Scan2024-06-11T10:27:48+00:00
Next Scan 2024-07-11T10:27:48+00:00

Last Scan

Scanned2024-06-11T10:27:48+00:00
URL https://promocodes.com/robots.txt
Redirect https://www.promocodes.com:443/robots.txt
Redirect Domain www.promocodes.com
Redirect Base promocodes.com
Domain IPs 44.215.44.99, 52.20.229.107, 54.152.237.238
Redirect IPs 108.157.254.33, 108.157.254.36, 108.157.254.41, 108.157.254.79
Response IP 108.157.254.36
Found Yes
Hash 794859107769ed18632359ac67fe75e7c2020429609c004f4f31efb8dac74772
SimHash c92158f0d801

Groups

*

Rule Path
Disallow /rc/
Disallow /rm/
Disallow /mcpc/
Disallow /mcpc2/
Disallow /mcpc3/
Disallow /cpc/
Disallow /coupon/share/
Disallow /c/
Disallow /blog/tipjar?t=*
Disallow /blog/seemoreby*
Disallow /blog/tags?t=*

adidxbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

Other Records

Field Value
sitemap https://www.promocodes.com/sitemap.xml
sitemap https://www.promocodes.com/sitemap-base.xml.gz
sitemap https://www.promocodes.com/sitemap-merchants.xml.gz
sitemap https://www.promocodes.com/sitemap-categories.xml.gz
sitemap https://www.promocodes.com/sitemap-blog.xml.gz