cdn-gateflipp.flippback.com
robots.txt

Robots Exclusion Standard data for cdn-gateflipp.flippback.com

Resource Scan

Scan Details

Site Domain cdn-gateflipp.flippback.com
Base Domain flippback.com
Scan Status Ok
Last Scan2024-04-29T06:57:11+00:00
Next Scan 2024-05-29T06:57:11+00:00

Last Scan

Scanned2024-04-29T06:57:11+00:00
URL https://cdn-gateflipp.flippback.com/robots.txt
Domain IPs 18.164.174.111, 18.164.174.115, 18.164.174.19, 18.164.174.99
Response IP 18.165.171.56
Found Yes
Hash 867c5338c07639f35ae0668f800129931ca0eb5c8e296e4534c8b27ee652c164
SimHash a68409ad60f0

Groups

*

Rule Path
Disallow /bf/terms_of_use
Disallow /bf/feedbacks
Disallow /bf/merchant_data_feed
Disallow /bf/merchants
Disallow /bf/publisher_feeds
Disallow /bf/share
Disallow /bf/shopping_lists

Comments

  • See http://www.robotstxt.org/wc/norobots.html for documentation on how to use the robots.txt file
  • To ban all spiders from the entire site uncomment the next two lines:
  • User-Agent: *
  • Disallow: /