Log In Sign Up

playpilot-web.web.app
robots.txt

Robots Exclusion Standard data for playpilot-web.web.app

Resource Scan

Scan Details

Site Domain playpilot-web.web.app
Base Domain playpilot-web.web.app
Scan Status Ok
Last Scan2024-09-18T06:35:40+00:00
Next Scan 2024-09-25T06:35:40+00:00

Last Scan

Scanned2024-09-18T06:35:40+00:00
URL https://playpilot-web.web.app/robots.txt
Domain IPs 199.36.158.100, 2620:0:890::100
Response IP 199.36.158.100
Found Yes
Hash 12dfa62d95a2c269db6ed269984c2f9189130097f9722a1802c86a6bd26f673b
SimHash efecc863efb4

Groups

*

Rule Path
Disallow /gravity/
Disallow /notifications/
Disallow /weekly-digest/
Disallow /search/
Disallow /*?imdb_score*
Disallow /*%26imdb_score*
Disallow /*?year*
Disallow /*%26year*
Disallow /*%26country
Disallow /*?country
Disallow /*%26length
Disallow /*?length
Disallow /titles/*/
Disallow /titles/*/*sorting
Disallow /titles/service/*/*/
Disallow /titles/service/*/*/*sorting
Disallow /titles/*type
Disallow /titles/*type*sorting
Disallow /titles/*sorting*type
Disallow /titles/service/*/*type*sorting
Disallow /titles/service/*/*sorting*type
Disallow /titles/*imdb_score
Disallow /titles/*imdb_score*sorting
Disallow /titles/*sorting*imdb_score
Disallow /titles/service/*/*imdb_score*sorting
Disallow /titles/service/*/*sorting*imdb_score
Disallow /titles/*year
Disallow /titles/*year*sorting
Disallow /titles/*sorting*year
Disallow /titles/service/*/*year*sorting
Disallow /titles/service/*/*sorting*year
Disallow /titles/*length
Disallow /titles/*length*sorting
Disallow /titles/*sorting*length
Disallow /titles/service/*/*length*sorting
Disallow /titles/service/*/*sorting*length
Disallow /titles/*country
Disallow /titles/*country*sorting
Disallow /titles/*sorting*country
Disallow /titles/service/*/*country*sorting
Disallow /titles/service/*/*sorting*country
Allow /titles/?*sorting
Allow /titles/service/*/$
Allow /titles/service/*/?*sorting

Other Records

Field Value
crawl-delay 10
Back to top

Other Records

Field Value
sitemap http://sitemaps.playpilot.com/sitemap.xml
Back to top

Comments

  • Disallowed Pages
  • Disallowed Explore Parameters
  • Titles Page Settings
  • Disallow any genre page
  • Disallow any page that contains type
  • Disallow any page that contains imdb_score
  • Disallow any page that contains year
  • Disallow any page that contains length
  • Disallow any page that contains country
  • Allow sorting in main page
  • Allow service pages
  • Allow sorting in service pages
Back to top