panjavarnam.com
robots.txt

Robots Exclusion Standard data for panjavarnam.com

Resource Scan

Scan Details

Site Domain panjavarnam.com
Base Domain panjavarnam.com
Scan Status Ok
Last Scan2025-11-20T18:44:25+00:00
Next Scan 2025-12-04T18:44:25+00:00

Last Scan

Scanned2025-11-20T18:44:25+00:00
URL https://panjavarnam.com/robots.txt
Domain IPs 23.227.38.32
Response IP 23.227.38.32
Found Yes
Hash c47a26db0099dfcfc1fea0912d8333e2dcd2704e7f6ce26f35cac03567cf2d90
SimHash eb31c0c2dc8b

Groups

*

Rule Path
Disallow
Disallow /collections/all/
Disallow /collections/all/*
Disallow /en-us/collections/all
Disallow /en-us/collections/all/*
Disallow /hi/collections/all
Disallow /hi/collections/all/*
Disallow /sitemap_products_1.xml
Disallow /sitemap_products_2.xml
Disallow /sitemap_products_3.xml
Disallow /sitemap_products_4.xml
Disallow /en-us/sitemap_products_1.xml
Disallow /a/downloads/-/*
Disallow /admin
Disallow /cart
Disallow /orders
Disallow /checkouts/
Disallow /checkout
Disallow /carts
Disallow /account
Disallow /collections/*sort_by*
Disallow /*/collections/*sort_by*
Disallow /collections/*%2B*
Disallow /collections/*%2B*
Disallow /collections/*%2B*
Disallow /*/collections/*%2B*
Disallow /*/collections/*%2B*
Disallow /*/collections/*%2B*
Disallow */collections/*filter*%26*filter*
Disallow /blogs/*%2B*
Disallow /blogs/*%2B*
Disallow /blogs/*%2B*
Disallow /*/blogs/*%2B*
Disallow /*/blogs/*%2B*
Disallow /*/blogs/*%2B*
Disallow /*?*oseid=*
Disallow /*preview_theme_id*
Disallow /*preview_script_id*
Disallow /*/*?*ls=*&ls=*
Disallow /*/*?*ls%3D*%3Fls%3D*
Disallow /*/*?*ls%3D*%3Fls%3D*
Disallow /search
Disallow /apple-app-site-association
Disallow /services/login_with_shop
Disallow /cdn/wpm/*.js
Disallow /en-us/*
Disallow /en-canada/*
Disallow /products/*?pr_prod_strat=*
Disallow /collections/*/*
Allow /collections/*/products/*
Disallow /recommendations/
Disallow /collections/archives
Disallow *.atom
Disallow /*?srsltid=
Disallow /*?page=
Allow /checkouts/internal/preloads.js

chatgpt

Rule Path
Allow /

Other Records

Field Value
crawl-delay 10

gptbot

Rule Path
Allow /

Other Records

Field Value
crawl-delay 10

chatgpt-user

Rule Path
Allow /

Other Records

Field Value
crawl-delay 10

oai-search

Rule Path
Allow /

Other Records

Field Value
crawl-delay 10

bard

Rule Path
Allow /

Other Records

Field Value
crawl-delay 10

gemini

Rule Path
Allow /

Other Records

Field Value
crawl-delay 10

oai-searchbot

Rule Path
Allow /

Other Records

Field Value
crawl-delay 10

openai

Rule Path
Allow /

Other Records

Field Value
crawl-delay 10

generativeai

Rule Path
Allow /

Other Records

Field Value
crawl-delay 10

predictiveai

Rule Path
Allow /

Other Records

Field Value
crawl-delay 10

bingbot

Rule Path
Allow /

Other Records

Field Value
crawl-delay 15

Other Records

Field Value
sitemap https://panjavarnam.com/apps/sitemap/index.xml

Comments

  • Allow AI and generative bots