latest.playpilot.com
robots.txt

Robots Exclusion Standard data for latest.playpilot.com

Resource Scan

Scan Details

Site Domain latest.playpilot.com
Base Domain playpilot.com
Scan Status Ok
Last Scan2026-01-13T20:19:21+00:00
Next Scan 2026-01-27T20:19:21+00:00

Last Scan

Scanned2026-01-13T20:19:21+00:00
URL https://latest.playpilot.com/robots.txt
Redirect https://www.playpilot.com/robots.txt
Redirect Domain www.playpilot.com
Redirect Base playpilot.com
Domain IPs 104.26.2.138, 104.26.3.138, 172.67.69.152, 2606:4700:20::681a:28a, 2606:4700:20::681a:38a, 2606:4700:20::ac43:4598
Redirect IPs 104.26.2.138, 104.26.3.138, 172.67.69.152, 2606:4700:20::681a:28a, 2606:4700:20::681a:38a, 2606:4700:20::ac43:4598
Response IP 172.67.69.152
Found Yes
Hash d4c0b472ce3f3dcdc76bec13f14a15f287d767f52e4e3dc43cd2ab12c53a94f0
SimHash afeac8634fb4

Groups

*

Rule Path
Disallow /cdn-cgi/
Disallow /gravity/
Disallow /notifications/
Disallow /weekly-digest/
Disallow /search/
Disallow /*?imdb_score*
Disallow /*%26imdb_score*
Disallow /*?year*
Disallow /*%26year*
Disallow /*%26country
Disallow /*?country
Disallow /*%26countries
Disallow /*?countries
Disallow /*%26country_codes
Disallow /*?country_codes
Disallow /*%26length
Disallow /*?length
Disallow /*%26imdb_score
Disallow /*?imdb_score
Disallow /titles/*/
Disallow /titles/*/*sorting
Disallow /titles/service/*/*/
Disallow /titles/service/*/*/*sorting
Disallow /titles/*type
Disallow /titles/*type*sorting
Disallow /titles/*sorting*type
Disallow /titles/service/*/*type*sorting
Disallow /titles/service/*/*sorting*type
Disallow /titles/*imdb_score
Disallow /titles/*imdb_score*sorting
Disallow /titles/*sorting*imdb_score
Disallow /titles/service/*/*imdb_score*sorting
Disallow /titles/service/*/*sorting*imdb_score
Disallow /titles/*year
Disallow /titles/*year*sorting
Disallow /titles/*sorting*year
Disallow /titles/service/*/*year*sorting
Disallow /titles/service/*/*sorting*year
Disallow /titles/*length
Disallow /titles/*length*sorting
Disallow /titles/*sorting*length
Disallow /titles/service/*/*length*sorting
Disallow /titles/service/*/*sorting*length
Disallow /titles/*country
Disallow /titles/*country*sorting
Disallow /titles/*sorting*country
Disallow /titles/service/*/*country*sorting
Disallow /titles/service/*/*sorting*country
Allow /titles/?*sorting
Allow /titles/service/*/$
Allow /titles/service/*/?*sorting

Other Records

Field Value
crawl-delay 10

Other Records

Field Value
sitemap https://sitemaps.playpilot.com/sitemap.xml

Comments

  • This path is used internally by Cloudflare and Google encounters errors when crawling it
  • Disallowed Pages
  • Disallowed Explore Parameters
  • Titles Page Settings
  • Disallow any genre page
  • Disallow any page that contains type
  • Disallow any page that contains imdb_score
  • Disallow any page that contains year
  • Disallow any page that contains length
  • Disallow any page that contains country
  • Allow sorting in main page
  • Allow service pages
  • Allow sorting in service pages