remove-bg.ai
robots.txt

Robots Exclusion Standard data for remove-bg.ai

Resource Scan

Scan Details

Site Domain remove-bg.ai
Base Domain remove-bg.ai
Scan Status Ok
Last Scan2024-06-04T02:31:16+00:00
Next Scan 2024-06-11T02:31:16+00:00

Last Scan

Scanned2024-06-04T02:31:16+00:00
URL https://remove-bg.ai/robots.txt
Domain IPs 104.26.12.42, 104.26.13.42, 172.67.68.204, 2606:4700:20::681a:c2a, 2606:4700:20::681a:d2a, 2606:4700:20::ac43:44cc
Response IP 104.26.12.42
Found Yes
Hash 16f3f857862ea0f2b3f8ed724dca5f3924f45a2569a7a90155dc58f7f36cf51e
SimHash 281c88507912

Groups

*

Rule Path
Allow /

backlinkcrawler

Rule Path
Disallow /

backlink-ceck

Rule Path
Disallow /

backlink-check

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://remove-bg.ai/sitemap.xml

Comments

  • Disallow