appfunde.com
robots.txt

Robots Exclusion Standard data for appfunde.com

Resource Scan

Scan Details

Site Domain appfunde.com
Base Domain appfunde.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-09-04T18:07:46+00:00
Next Scan 2025-11-03T18:07:46+00:00

Last Successful Scan

Scanned2025-07-07T00:39:07+00:00
URL https://appfunde.com/robots.txt
Redirect https://www.appfunde.com/robots.txt
Redirect Domain www.appfunde.com
Redirect Base appfunde.com
Domain IPs 104.21.91.215, 172.67.180.120, 2606:4700:3035::6815:5bd7, 2606:4700:3035::ac43:b478
Redirect IPs 104.21.91.215, 172.67.180.120, 2606:4700:3035::6815:5bd7, 2606:4700:3035::ac43:b478
Response IP 104.21.91.215
Found Yes
Hash d9fd6d7bfb4b241e857d69bf135fae2d3c627f82ecf58a8c98c9ab0b35b3ae94
SimHash 105c48faff14

Groups

*

Rule Path
Allow /

baiduspider*
sogou*

Rule Path
Disallow /

adidxbot
microsoftpreview
bingpreview
ahrefsbot
blexbot
ccbot
cliqzbot
dotbot
ia_archiver
mbcrawler
mj12bot
photon
scrapy
semrushbot
linguee

Rule Path
Disallow /