foter.com
robots.txt

Robots Exclusion Standard data for foter.com

Resource Scan

Scan Details

Site Domain foter.com
Base Domain foter.com
Scan Status Ok
Last Scan2024-11-10T17:07:34+00:00
Next Scan 2024-11-17T17:07:34+00:00

Last Scan

Scanned2024-11-10T17:07:34+00:00
URL https://foter.com/robots.txt
Domain IPs 104.22.12.38, 104.22.13.38, 172.67.36.102, 2606:4700:10::6816:c26, 2606:4700:10::6816:d26, 2606:4700:10::ac43:2466
Response IP 104.22.13.38
Found Yes
Hash 733c7861a2006d1e613f80814618fead49dc18f0be0bdebc7f00564b087fa903
SimHash 292f53984f9a

Groups

*

Rule Path
Disallow /explore/p/
Disallow /amzn/
Disallow /amznc/
Disallow /pp/
Disallow /explore/pr/
Disallow /explore/por/
Disallow /explore/as/
Disallow /explore/asp/
Disallow /explore/ws/
Disallow /explore/es/
Disallow /photo4/*/embed/
Disallow /f7/*
Disallow /re9/*
Disallow /action/
Disallow /action/go/
Disallow /explore/save/
Disallow /explore/amp/p/
Disallow /cart/

Other Records

Field Value
sitemap https://foter.com/sitemap/sitemap_explore_category_1.xml.gz
sitemap https://foter.com/sitemap/sitemap_explore_board_1.xml.gz
sitemap https://foter.com/sitemap/sitemap_explore_article_1.xml.gz
sitemap https://foter.com/sitemap/sitemap_explore_images_1.xml.gz
sitemap https://foter.com/sitemap/sitemap_explore_products_1.xml.gz