amp.interestingengineering.com
robots.txt

Robots Exclusion Standard data for amp.interestingengineering.com

Resource Scan

Scan Details

Site Domain amp.interestingengineering.com
Base Domain interestingengineering.com
Scan Status Ok
Last Scan2025-09-19T06:11:33+00:00
Next Scan 2025-10-19T06:11:33+00:00

Last Scan

Scanned2025-09-19T06:11:33+00:00
URL https://amp.interestingengineering.com/robots.txt
Redirect https://interestingengineering.com/robots.txt
Redirect Domain interestingengineering.com
Redirect Base interestingengineering.com
Domain IPs 104.20.25.137, 172.66.155.11, 2606:4700:10::6814:1989, 2606:4700:10::ac42:9b0b
Redirect IPs 104.20.25.137, 172.66.155.11, 2606:4700:10::6814:1989, 2606:4700:10::ac42:9b0b
Response IP 172.66.155.11
Found Yes
Hash 697a3dade7ebe801c81cfcff626395a4f2e04d4000141025f4f29b71fc947771
SimHash 479f494083c7

Groups

*

Rule Path
Disallow /s/*
Disallow /redir/*
Disallow /partial/*
Disallow /*?context_item_id
Disallow /search
Disallow /signup
Disallow /newsletters/
Disallow /*?group=test_a
Disallow /*?group=test_b
Disallow /newsletters/engineer-pros/
Allow /newsletters/engineer-pros
Allow /newsletters/engineer-pros/subscribe
Disallow /newsletters/ie-originals/
Allow /newsletters/ie-originals
Allow /newsletters/ie-originals/subscribe
Disallow /newsletters/mechanical/
Allow /newsletters/mechanical
Allow /newsletters/mechanical/subscribe
Disallow /newsletters/electrical/
Allow /newsletters/electrical
Allow /newsletters/electrical/subscribe
Disallow /newsletters/ai-logs/
Allow /newsletters/ai-logs
Allow /newsletters/ai-logs/subscribe
Disallow /newsletters/aerospace/
Allow /newsletters/aerospace
Allow /newsletters/aerospace/subscribe
Disallow /newsletters/software/
Allow /newsletters/software
Allow /newsletters/software/subscribe
Disallow /newsletters/sustainability/
Allow /newsletters/sustainability
Allow /newsletters/sustainability/subscribe
Disallow /newsletters/the-blueprint/
Allow /newsletters/the-blueprint
Allow /newsletters/the-blueprint/subscribe
Disallow /reviews/

ai2bot

Rule Path
Disallow /

ai2bot-dolma

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

applebot-extended

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

claude-web

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

cohere-ai

Rule Path
Disallow /

diffbot

Rule Path
Disallow /

duckassistbot

Rule Path
Disallow /

facebookbot

Rule Path
Disallow /

facebookexternalhit

Rule Path
Disallow /

friendlycrawler

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

iaskspider/2.0

Rule Path
Disallow /

icc-crawler

Rule Path
Disallow /

imagesiftbot

Rule Path
Disallow /

img2dataset

Rule Path
Disallow /

isscyberriskcrawler

Rule Path
Disallow /

kangaroo bot

Rule Path
Disallow /

meta-externalagent

Rule Path
Disallow /

meta-externalfetcher

Rule Path
Disallow /

omgili

Rule Path
Disallow /

omgilibot

Rule Path
Disallow /

perplexitybot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

scrapy

Rule Path
Disallow /

sidetrade indexer bot

Rule Path
Disallow /

timpibot

Rule Path
Disallow /

velenpublicwebcrawler

Rule Path
Disallow /

webzio-extended

Rule Path
Disallow /

youbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://interestingengineering.com/sitemap_index.xml
sitemap https://interestingengineering.com/news-sitemap.xml