developers.sap.com
robots.txt

Robots Exclusion Standard data for developers.sap.com

Resource Scan

Scan Details

Site Domain developers.sap.com
Base Domain sap.com
Scan Status Ok
Last Scan2025-12-03T07:37:17+00:00
Next Scan 2025-12-17T07:37:17+00:00

Last Scan

Scanned2025-12-03T07:37:17+00:00
URL https://developers.sap.com/robots.txt
Domain IPs 23.58.144.140, 23.58.144.154, 2600:1413:5000:13::1737:27cc, 2600:1413:5000:13::1737:27ce
Response IP 23.32.39.145
Found Yes
Hash f6dcc38d3a84edf0057084802284d461ba75411a1c8554dfa361beedd03c19f4
SimHash 558c5b5044f6

Groups

*

Rule Path
Disallow /

googlebot

Rule Path
Allow /

googlebot-image

Rule Path
Allow /

googlebot-news

Rule Path
Allow /

chrome-lighthouse

Rule Path
Allow /

google web preview

Rule Path
Allow /

adsbot-google

Rule Path
Allow /

adsbot-google-mobile

Rule Path
Allow /

feedfetcher-google

Rule Path
Allow /

googlebot-video

Rule Path
Allow /

google-inspectiontool

Rule Path
Allow /

googleother

Rule Path
Allow /

google-safety

Rule Path
Allow /

mediapartners-google

Rule Path
Allow /

storebot-google

Rule Path
Allow /

baiduspider

Rule Path
Allow /

coccocbot

Rule Path
Allow /

daum

Rule Path
Allow /

duckduckbot

Rule Path
Allow /

ecosia_bot

Rule Path
Allow /

archive.org_bot

Rule Path
Allow /

bingpreview

Rule Path
Allow /

bingbot

Rule Path
Allow /

mojeekbot

Rule Path
Allow /

yeti

Rule Path
Allow /

seznambot

Rule Path
Allow /

sogou web spider

Rule Path
Allow /

twitterbot

Rule Path
Allow /

yahoo! slurp

Rule Path
Allow /

yandexaccessibilitybot

Rule Path
Allow /

yandexmobilebot

Rule Path
Allow /

yandex

Rule Path
Allow /

amazonbot

Rule Path
Allow /

anthropic-ai

Rule Path
Allow /

claudebot

Rule Path
Allow /

claude-web

Rule Path
Allow /

ccbot

Rule Path
Allow /

google-extended

Rule Path
Allow /

facebookbot

Rule Path
Allow /

chatgpt-user

Rule Path
Allow /

gptbot

Rule Path
Allow /

perplexitybot

Rule Path
Allow /

perplexity-user

Rule Path
Allow /

Other Records

Field Value
sitemap https://developers.sap.com/sitemap_index.xml

Comments

  • robots.txt for https://developers.sap.com/
  • Last updated 2025-10-16
  • AI and Chat Agents