Log In Sign Up

oneida-air.com
robots.txt

Robots Exclusion Standard data for oneida-air.com

Resource Scan

Scan Details

Site Domain oneida-air.com
Base Domain oneida-air.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2026-01-25T03:20:47+00:00
Next Scan 2026-02-24T03:20:47+00:00

Last Successful Scan

Scanned2025-12-04T03:05:44+00:00
URL https://oneida-air.com/robots.txt
Redirect https://www.oneida-air.com/robots.txt
Redirect Domain www.oneida-air.com
Redirect Base oneida-air.com
Domain IPs 104.26.4.181, 104.26.5.181, 172.67.68.43, 2606:4700:20::681a:4b5, 2606:4700:20::681a:5b5, 2606:4700:20::ac43:442b
Redirect IPs 104.26.4.181, 104.26.5.181, 172.67.68.43, 2606:4700:20::681a:4b5, 2606:4700:20::681a:5b5, 2606:4700:20::ac43:442b
Response IP 104.26.4.181
Found Yes
Hash 87d66fdd007e840b7db3fa0ab8435fb6d74b99227a65d8f77ede7466f907e7ea
SimHash ee113950c786

Groups

*

Rule Path
Disallow /checkout/
Disallow /onestepcheckout/
Disallow /customer/
Disallow /customer/account/
Allow /customer/account/create/
Allow /customer/account/login/
Allow /customer/account/forgotpassword/
Disallow /catalogsearch/
Allow /catalogsearch/advanced/
Disallow /catalog/product_compare/
Disallow /sendfriend/
Disallow /catalog/category/view/
Allow /catalog/category/view/id/274
Allow /catalog/category/view/id/275
Allow /catalog/category/view/id/276
Allow /catalog/category/view/id/277
Allow /catalog/category/view/id/278
Disallow /catalog/product/view/
Disallow /review/product/post/id/
Disallow /tag/
Disallow /*?dir*
Disallow /*?dir=desc
Disallow /*?dir=asc
Disallow /*?limit=all
Disallow /*?mode*
Disallow /*SID%3D
Disallow /*.php$
Disallow /app/
Disallow /asset/
Disallow /bin/
Disallow /dev/
Disallow /generated/
Disallow /*giveaway*
Disallow /lib/
Disallow /phpserver/
Disallow /rest/
Disallow /sales/
Allow /sales/order/history/
Disallow /setup/
Disallow /static/
Disallow /update/
Disallow /var/
Disallow /vendor/

aspiegelbot
petalbot
ahrefsbot
seznambot
semrushbot
dotbot
mauibot

Rule Path
Disallow /

adidxbot
bingbot
pinterestbot
slurp
yandexbot
seekportbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 30

ai2bot
amazonbot
amazon-kendra
anthropic-ai
applebot
applebot-extended
awariorssbot
awariosmartbot
brightbot
bytespider
chatgpt-user
claudebot
diffbot
duckassistbot
facebookbot
friendlycrawler
google-extended
gptbot
iaskspider/2.0
icc-crawler
img2dataset
kangaroo bot
linerbot
machinelearningforpeacebot
meltwater
meta-externalagent
meta-externalfetcher
nicecrawler
oai-searchbot
omgili
omgilibot
pangubot
perplexitybot
perplexity-user
piplbot
qualifiedbot
scoop.it
seekr
semrushbot-ocob
sidetrade indexer bot
timpibot
velenpublicwebcrawler
webzio-extended
youbot

Rule Path
Disallow /

*

Rule Path
Disallow /oneida_db_sql_backup
Back to top

Other Records

Field Value
sitemap https://www.oneida-air.com/sitemap.xml
Back to top

Comments

  • Bad Bots
  • Overeager Bots
  • NOTICE: The collection of content and other data on this
  • site through automated means, including any device, tool,
  • or process designed to data mine or scrape content, is
  • prohibited except (1) for the purpose of search engine indexing or
  • artificial intelligence retrieval augmented generation or (2) with express
  • written permission from this site’s operator.
  • To request permission to license our intellectual
  • property and/or other materials, please contact this
  • site’s operator directly.
  • AI Bots
  • Food for Trolls
  • .-·¯¯¯¯¯·-._
  • ,¯· ¨-----¨ ·,`
  • (/====~~~--· //
  • \\¯¯¯¨¨¨ (/
  • `\====~-- `\
  • \\¯¯¨¨ })
  • `\==~-· /
  • `)¯¨ /´
  • /=· ´
  • ´¨´
  • Thanks for visiting
  • Oneida Air Systems!
Back to top