appopts.com
robots.txt

Robots Exclusion Standard data for appopts.com

Resource Scan

Scan Details

Site Domain appopts.com
Base Domain appopts.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-09-04T23:47:09+00:00
Next Scan 2025-11-03T23:47:09+00:00

Last Successful Scan

Scanned2025-07-07T00:44:37+00:00
URL https://appopts.com/robots.txt
Redirect https://www.appopts.com/robots.txt
Redirect Domain www.appopts.com
Redirect Base appopts.com
Domain IPs 104.21.90.251, 172.67.163.91, 2606:4700:3030::ac43:a35b, 2606:4700:3037::6815:5afb
Redirect IPs 104.21.90.251, 172.67.163.91, 2606:4700:3030::ac43:a35b, 2606:4700:3037::6815:5afb
Response IP 172.67.163.91
Found Yes
Hash d9fd6d7bfb4b241e857d69bf135fae2d3c627f82ecf58a8c98c9ab0b35b3ae94
SimHash 105c48faff14

Groups

*

Rule Path
Allow /

baiduspider*
sogou*

Rule Path
Disallow /

adidxbot
microsoftpreview
bingpreview
ahrefsbot
blexbot
ccbot
cliqzbot
dotbot
ia_archiver
mbcrawler
mj12bot
photon
scrapy
semrushbot
linguee

Rule Path
Disallow /