cineserie.com
robots.txt

Robots Exclusion Standard data for cineserie.com

Resource Scan

Scan Details

Site Domain cineserie.com
Base Domain cineserie.com
Scan Status Ok
Last Scan2024-06-01T06:57:41+00:00
Next Scan 2024-06-08T06:57:41+00:00

Last Scan

Scanned2024-06-01T06:57:41+00:00
URL https://cineserie.com/robots.txt
Redirect https://www.cineserie.com/robots.txt
Redirect Domain www.cineserie.com
Redirect Base cineserie.com
Domain IPs 104.17.84.119, 104.17.85.119
Redirect IPs 104.17.84.119, 104.17.85.119
Response IP 104.17.84.119
Found Yes
Hash 8bae4f9c60ad3a5e7067d8a4c092a41cb1729d934236edbb80f87ca7f02bb71b
SimHash 7db754366e9b

Groups

*

Rule Path
Disallow /cdn-cgi/
Disallow /api/

aspiegelbot
blexbot
barkrowler
dotbot
mauibot
nimbostratus-bot
petalbot
seznambot
sogou
serpstatbot
trendiction
textbulkerbot

Rule Path
Disallow /cdn-cgi/
Disallow /api/

Other Records

Field Value
crawl-delay 180

Other Records

Field Value
sitemap https://www.cineserie.com/sitemaps/sitemap.xml

Comments

  • Disallow: /search
  • Disallow: /?s=

Warnings

  • 1 invalid line.