communityrewards.me
robots.txt

Robots Exclusion Standard data for communityrewards.me

Resource Scan

Scan Details

Site Domain communityrewards.me
Base Domain communityrewards.me
Scan Status Ok
Last Scan2024-06-16T19:16:12+00:00
Next Scan 2024-06-30T19:16:12+00:00

Last Scan

Scanned2024-06-16T19:16:12+00:00
URL https://communityrewards.me/robots.txt
Domain IPs 104.26.8.220, 104.26.9.220, 172.67.73.154, 2606:4700:20::681a:8dc, 2606:4700:20::681a:9dc, 2606:4700:20::ac43:499a
Response IP 104.26.8.220
Found Yes
Hash 57c212c70e4c835313967f6c63bf87986dd835f96b88e4719b79f0da98199d78
SimHash 8001ab457964

Groups

*

Rule Path Comment
Allow *.js global
Allow /assets/packs/* -
Disallow /referral -
Disallow /rewards -
Disallow /privacy -
Disallow /*/reviews -
Disallow /saasagreementstandard -

Comments

  • See http://www.robotstxt.org/robotstxt.html for documentation on how to use the robots.txt file