au.cupshe.com
robots.txt

Robots Exclusion Standard data for au.cupshe.com

Resource Scan

Scan Details

Site Domain au.cupshe.com
Base Domain cupshe.com
Scan Status Ok
Last Scan2024-11-14T12:04:54+00:00
Next Scan 2024-11-28T12:04:54+00:00

Last Scan

Scanned2024-11-14T12:04:54+00:00
URL https://au.cupshe.com/robots.txt
Domain IPs 13.35.210.10, 13.35.210.111, 13.35.210.125, 13.35.210.94, 2600:9000:2078:4000:1e:a924:35c0:93a1, 2600:9000:2078:5400:1e:a924:35c0:93a1, 2600:9000:2078:8a00:1e:a924:35c0:93a1, 2600:9000:2078:9000:1e:a924:35c0:93a1, 2600:9000:2078:9800:1e:a924:35c0:93a1, 2600:9000:2078:b000:1e:a924:35c0:93a1, 2600:9000:2078:be00:1e:a924:35c0:93a1, 2600:9000:2078:d600:1e:a924:35c0:93a1
Response IP 13.35.210.10
Found Yes
Hash de14a332f990d26a11ba344b60c3ecd4d8afb5c1313759f67d189a0e4caeaf88
SimHash 05549863f590

Groups

*

Rule Path
Disallow /account
Disallow /orderTrack
Disallow /center?type=orderHistory

adsbot-google

Rule Path
Disallow /account
Disallow /center?type=orderHistory

nutch

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /account
Disallow /orderTrack
Disallow /center?type=orderHistory

Other Records

Field Value
crawl-delay 10

ahrefssiteaudit

Rule Path
Disallow /account
Disallow /orderTrack
Disallow /center?type=orderHistory

Other Records

Field Value
crawl-delay 10

mj12bot

Rule Path
Disallow /account
Disallow /orderTrack
Disallow /center?type=orderHistory

Other Records

Field Value
crawl-delay 10

pinterest

Rule Path
Disallow /account
Disallow /orderTrack
Disallow /center?type=orderHistory

Other Records

Field Value
crawl-delay 1

googlebot

Rule Path
Disallow

googlebot-image

Rule Path
Disallow

mediapartners-google

Rule Path
Disallow

gtmetrix

Rule Path
Disallow

google pagespeed insights

Rule Path
Disallow

Other Records

Field Value
sitemap https://au.cupshe.com/sitemap.xml
sitemap https://de.cupshe.com/sitemap.xml
sitemap https://de.cupshe.com/sitemap.xml

Comments

  • Google adsbot ignores robots.txt unless specifically named!