static.boredpanda.com
robots.txt

Robots Exclusion Standard data for static.boredpanda.com

Resource Scan

Scan Details

Site Domain static.boredpanda.com
Base Domain boredpanda.com
Scan Status Ok
Last Scan2024-09-18T10:05:45+00:00
Next Scan 2024-09-25T10:05:45+00:00

Last Scan

Scanned2024-09-18T10:05:45+00:00
URL https://static.boredpanda.com/robots.txt
Redirect https://www.boredpanda.com/robots.txt
Redirect Domain www.boredpanda.com
Redirect Base boredpanda.com
Domain IPs 13.226.2.10, 13.226.2.27, 13.226.2.31, 13.226.2.94
Redirect IPs 13.32.121.114, 13.32.121.31, 13.32.121.42, 13.32.121.89
Response IP 18.165.140.31
Found Yes
Hash f85d7c4647adbbfd6d0b2e2afb6c284058b52a49823281f14243519a3c512d4e
SimHash ce2c7f91cbd1

Groups

facebookexternalhit

Rule Path
Allow /

twitterbot

Rule Path
Allow /*?utm_

*

Rule Path
Allow /
Disallow /*wp-admin/
Disallow /*wp-includes
Disallow /*wp-content
Disallow /*wp-json
Disallow /*?
Allow /*?comment
Allow /*?cexp_id=
Allow /*?show=trending
Allow /*?show=recent
Allow /*wp-includes*.jpg
Allow /*wp-content*.jpg
Allow /*wp-includes*.jpeg
Allow /*wp-content*.jpeg
Allow /*wp-includes*.jpe
Allow /*wp-content*.jpe
Allow /*wp-includes*.png
Allow /*wp-content*.png
Allow /*wp-includes*.css
Allow /*wp-content*.css
Allow /*wp-includes*.js
Allow /*wp-content*.js
Allow /*wp-includes*.gif
Allow /*wp-content*.gif
Allow /*wp-includes*.svg
Allow /*wp-content*.svg
Allow /*wp-includes*.webp
Allow /*wp-content*.webp
Allow /*?media_id

Other Records

Field Value
sitemap https://www.boredpanda.com/sitemap.xml
sitemap https://www.boredpanda.com/tags-sitemap.xml
sitemap https://www.boredpanda.com/categories-sitemap.xml
sitemap https://www.boredpanda.com/news-sitemap.xml
sitemap https://www.boredpanda.com/authors-sitemap.xml