Log In Sign Up

pixabay.com
robots.txt

Robots Exclusion Standard data for pixabay.com

Resource Scan

Scan Details

Site Domain pixabay.com
Base Domain pixabay.com
Scan Status Ok
Last Scan2025-03-07T15:43:09+00:00
Next Scan 2025-03-21T15:43:09+00:00

Last Scan

Scanned2025-03-07T15:43:09+00:00
URL https://www.pixabay.com/robots.txt
Domain IPs 104.18.40.96, 172.64.147.160, 2606:4700:4400::6812:2860, 2606:4700:4400::ac40:93a0
Response IP 172.64.147.160
Found Yes
Hash 1b7d510089136997c3c11ee8dd7975afdaeaec5ff44779cf9dcb2d3b6004597c
SimHash 645e917638b7

Groups

*

Rule Path
Allow /api/docs/
Allow /static/*.*
Disallow *?*orientation=*
Disallow *?*manual_search=*
Disallow *?*min_width=*
Disallow *?*min_height=*
Disallow *?*date=*
Disallow *?*colors=*
Disallow *?*order=*
Disallow *?*animation=*
Disallow *?*resolution_hd=*
Disallow *?*genre=*
Disallow *?*mood=*
Disallow *?*movement=*
Disallow *?*theme=*
Disallow /static/
Disallow /*/accounts/login/?
Disallow /accounts/login/?
Disallow /*/accounts/logout/
Disallow /accounts/logout/
Disallow /*/accounts/follow*
Disallow /accounts/follow*
Disallow /*/accounts/messages/
Disallow /accounts/register/*
Disallow /*/accounts/register/*
Disallow /*/blog/comments/
Disallow /blog/comments/
Disallow /bootstrap/*
Disallow /*/bootstrap/*
Disallow /*/feeds/
Disallow /feeds/
Disallow /*/forum/
Disallow /forum/
Disallow /*/users/*/collections/
Disallow /*/images/tools/
Disallow /*/images/comments/
Disallow /*/images/download/*
Disallow /*/videos/comments/
Disallow /*/videos/download/*
Disallow /newsletter/
Disallow /get/
Disallow /api/
Disallow /cdn-cgi/*
Allow /

ahrefsbot
applebot-extended
bytespider
ccbot
claudebot
dotbot
google-extended
gptbot
linguatools
mj12bot
ocelli
riddlerbot
shopwiki
sistrix
sitebot
wbsearchbot
www.integromedb.org/crawler

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://pixabay.com/sitemap.xml.gz
Back to top

Warnings

  • 1 invalid line.
Back to top