pngedits.com
robots.txt

Robots Exclusion Standard data for pngedits.com

Resource Scan

Scan Details

Site Domain pngedits.com
Base Domain pngedits.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-09-30T15:20:49+00:00
Next Scan 2024-10-07T15:20:49+00:00

Last Successful Scan

Scanned2024-09-22T15:20:12+00:00
URL https://pngedits.com/robots.txt
Domain IPs 104.21.88.38, 172.67.172.72, 2606:4700:3030::6815:5826, 2606:4700:3031::ac43:ac48
Response IP 172.67.172.72
Found Yes
Hash 114596f36c714c6c0b01cc79dda0284c1d53fe1d474a4b57dbab2c8f4514f85c
SimHash 0025c1f27f11

Groups

*

Rule Path
Allow /
Disallow /download/
Disallow /ajax/
Disallow /fetch
Disallow /index.php/
Disallow /colors/
Disallow /*page%3D
Disallow /cameras
Disallow /*/following
Disallow /*/followers
Disallow /collection
Disallow /*?page=

ahrefsbot

Rule Path
Disallow /

barkrowler

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

grapeshotcrawler

Rule Path
Disallow /

hyscore

Rule Path
Disallow /

qwantify

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

seznambot

Rule Path
Disallow /

tineye-bot

Rule Path
Disallow /

coccocbot-image

Rule Path
Disallow /

coccocbot-web

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

musobot

Rule Path
Disallow /

proximic

Rule Path
Disallow /

qwantify/bleriot

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

mauibot

Rule Path
Disallow /

weborama-fetcher

Rule Path
Disallow /

clickagy intelligence bot

Rule Path
Disallow /

clickagy intelligence bot v2

Rule Path
Disallow /

hubspot crawler

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://pngedits.com/sitemaps.xml
sitemap https://pngedits.com/imageslist.xml
sitemap https://pngedits.com/sitemaps-cat.xml
sitemap https://pngedits.com/sitemaps-sub.xml
sitemap https://pngedits.com/sitemaps-images.xml