HTTPS surface reachable (robots ✓, sitemap ✓, title ✗)
Why it matters: Public files — robots.txt, sitemap.xml, head meta — are what attackers see first during reconnaissance. Misadvertised paths, stale sitemaps, and verbose generators leak more than intended (ISO 27001 A.8.9).
robots.txt
present
# Notice: Collection of data on Threads through automated means is
# prohibited unless you have express written permission from Threads
# and may only be conducted for the limited purpose contained in said
# permission.
# All authorized user-agents listed on this page must comply with Meta’s
# Automated Data Collection Terms available at:
# https://www.facebook.com/legal/automated_data_collection_terms
User-agent: Amazonbot
Disallow: /
User-agent: Applebot-Extended
Disallow: /
User-agent: Brightbot
Disallow: /
User-agent: ClaudeBot
Disallow: /
User-agent: Google-Extended
Disallow: /
User-agent: GPTBot
Disallow: /
User-agent: PerplexityBot
Disallow: /
User-agent: PetalBot
Disallow: /
User-agent: Scrapy
Disallow: /
User-agent: uptimerobot
Disallow: /
User-agent: viberbot
Disallow: /
User-agent: YaK
Disallow: /
User-agent: Yandex
Disallow: /
User-agent: Yeti
Disallow: /
User-agent: Applebot
Disallow: /accounts/
Disallow: /activity/
Disallow: /ajax/
Disallow: /client_error/
Disallow: /deck/
Disallow: /intent/
Disallow: /logging/
Disallow: /onboarding/
Disallow: /publicapi/
Disallow: /qp/batch_fetch_web/
Disallow: /query/
Disallow: /settings/
User-agent: Bingbot
Disallow: /*/c/
Disallow: /*/comments/
Disallow: /*/liked_by/
Disallow: /*/p/
Disallow: /accounts/
Disallow: /activity/
Disallow: /ajax/
Disallow: /client_error/
Disallow: /deck/
Disallow: /intent/
Disallow: /logging/
Disallow: /onboarding/
Disallow: /publicapi/
Disallow: /qp/batch_fetch_web/
Disallow: /query/
Disallow: /settings/
User-agent: Discordbot
Disallow: /accounts/
Disallow: /activity/
Disallow: /ajax/
Disallow: /client_error/
Disallow: /deck/
Disallow: /intent/
Disallow: /logging/
Disallow: /onboarding/
Disallow: /publicapi/
Disallow: /qp/batch_fetch_web/
Disallow: /query/
Disallow: /settings/
User-agent: DuckDuckBot
Disallow: /accounts/
Disallow: /activity/
Disallow: /ajax/
Disallow: /client_error/
Disallow: /deck/
Disallow: /intent/
Disallow: /logging/
Disallow: /onboarding/
Disallow: /publicapi/
Disallow: /qp/batch_fetch_web/
Disallow: /query/
Disallow: /settings/
User-agent: facebookexternalhit
Disallow: /accounts/
Disallow: /activity/
Disallow: /ajax/
Disallow: /client_error/
Disallow: /deck/
Disallow: /intent/
Disallow: /logging/
Disallow: /onboarding/
Disallow: /publicapi/
Disallow: /qp/batch_fetch_web/
Disallow: /query/
Disallow: /settings/
User-agent: Googlebot
Disallow: /*/c/
Disallow: /*/comments/
Disallow: /*/liked_by/
Disallow: /*/p/
Disallow: /accounts/
Disallow: /activity/
Disallow: /ajax/
Disallow: /client_error/
Disallow: /deck/
Disallow: /intent/
Disallow: /logging/
Disallow: /onboarding/
Disallow: /publicapi/
Disallow: /qp/batch_fetch_web/
Disallow: /query/
Disallow: /settings/
User-agent: Googlebot-Image
Disallow: /accounts/
Disallow: /activity/
Disallow: /ajax/
Disallow: /client_error/
Disallow: /deck/
Disallow: /intent/
Disallow: /logging/
Disallow: /onboarding/
Disallow: /publicapi/
Disallow: /qp/batch_fetch_web/
Disallow: /query/
Disallow: /settings/
User-agent: Googlebot-Video
Disallow: /accounts/
Disallow: /activity/
Disallow: /ajax/
Disallow: /client_error/
Disallow: /deck/
Disallow: /intent/
Disallow: /logging/
Disallow: /onboarding/
Disallow: /publicapi/
Disallow: /qp/batch_fetch_web/
Disallow: /query/
Disallow: /settings/
User-agent: Googlebot-News
Disallow: /accounts/
Disallow: /activity/
Disallow: /ajax/
Disallow: /client_error/
Disallow: /deck/
Disallow: /intent/
Disallow: /logging/
Disallow: /onboarding/
Disallow: /publicapi/
Disallow: /qp/batch_fetch_web/
Disallow: /query/
Disallow: /settings/
User-agent: Google-InspectionTool
Disallow: /accounts/
Disallow: /activity/
Disallow: /ajax/
Disallow: /client_error/
Disallow: /deck/
Disallow: /intent/
Disallow: /logging/
Disallow: /onboarding/
Disallow: /publicapi/
Disallow: /qp/batch_fetch_web/
Disallow: /query/
Disallow: /settings/
User-agent: LinkedInBot
Disallow: /accounts/
Disallow: /activity/
Disallow: /ajax/
Disallow: /client_error/
Disallow: /deck/
Disallow: /intent/
Disallow: /logging/
Disallow: /onboarding/
Disallow: /publicapi/
Disallow: /qp/batc
sitemap.xml
present — 0 url(s)
head
- title
- —
- description
- Join Threads to share ideas, ask questions, post random thoughts, find your people and more. Log in with your Instagram.
social
- og:site_name
- Threads
- og:type
- article
- og:title
- Threads • Log in
- og:description
- Join Threads to share ideas, ask questions, post random thoughts, find your people and more. Log in with your Instagram.
- og:url
- https://www.threads.com/
- og:image
- https://static.cdninstagram.com/rsrc.php/yd/r/kHwIMM5b8PW.webp
- twitter:card
- summary
- twitter:title
- Threads • Log in
- twitter:description
- Join Threads to share ideas, ask questions, post random thoughts, find your people and more. Log in with your Instagram.
- twitter:image
- https://static.cdninstagram.com/rsrc.php/yd/r/kHwIMM5b8PW.webp