appratemaster.com
robots.txt

Robots Exclusion Standard data for appratemaster.com

Resource Scan

Scan Details

Site Domain appratemaster.com
Base Domain appratemaster.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-06-29T03:40:53+00:00
Next Scan 2024-09-27T03:40:53+00:00

Last Successful Scan

Scanned2024-03-02T03:26:56+00:00
URL https://appratemaster.com/robots.txt
Redirect https://www.appratemaster.com/robots.txt
Redirect Domain www.appratemaster.com
Redirect Base appratemaster.com
Domain IPs 104.21.33.112, 172.67.161.227, 2606:4700:3031::6815:2170, 2606:4700:3031::ac43:a1e3
Redirect IPs 104.21.33.112, 172.67.161.227, 2606:4700:3031::6815:2170, 2606:4700:3031::ac43:a1e3
Response IP 104.21.33.112
Found Yes
Hash af3ba26b7e4837484fe4098b43fd94e84f3654c0c7b9b3e26c1e2422d25f4319
SimHash 001c48baef14

Groups

*

Rule Path
Allow /

baiduspider*
sogou*

Rule Path
Disallow /

bingbot
adidxbot
microsoftpreview
bingpreview
ahrefsbot
blexbot
ccbot
cliqzbot
dotbot
ia_archiver
mbcrawler
mj12bot
photon
scrapy
semrushbot
linguee

Rule Path
Disallow /