HTTPS surface reachable (robots ✓, sitemap ✗, title ✓)
Why it matters: Public files — robots.txt, sitemap.xml, head meta — are what attackers see first during reconnaissance. Misadvertised paths, stale sitemaps, and verbose generators leak more than intended (ISO 27001 A.8.9).
robots.txt
present
User-agent: *
Allow: /sitemaps_v3/*
Disallow: /auth/*
Disallow: /search*
Disallow: /*?*comment=*
Disallow: /*?*review=*
Disallow: /my/*
Disallow: /yours*
Disallow: /notifications
Disallow: /@*/*
# Auth-gated and redirect-only endpoints — no indexable content.
# `$` anchors the match so post/discussion/forum slugs starting with
# "new" (e.g. /p/news) remain crawlable.
Disallow: /login$
Disallow: /p/new$
Disallow: /discussions/new$
Disallow: /forums/new$
# Disable short links leading to external websites
# ========================
Disallow: /r/*
# Explicitly allow shortlink to posts
Allow: /r/p/*
# Disable indexing of search
Disallow: /search*
Sitemap: https://www.producthunt.com/sitemaps_v3/root_sitemap.xml.gz
Sitemap: https://www.producthunt.com/sitemaps_v3/stories_sitemap.xml.gz
Sitemap: https://www.producthunt.com/sitemaps_v3/topics_sitemap.xml.gz
Sitemap: https://www.producthunt.com/sitemaps_v3/newsletters_sitemap.xml.gz
Sitemap: https://www.producthunt.com/sitemaps_v3/forums_sitemap.xml.gz
Sitemap: https://www.producthunt.com/sitemaps_v3/discussions_sitemap.xml.gz
Sitemap: https://www.producthunt.com/sitemaps_v3/product_about_sitemap.xml.gz
Sitemap: https://www.producthunt.com/sitemaps_v3/product_alternatives_sitemap.xml.gz
Sitemap: https://www.producthunt.com/sitemaps_v3/product_reviews_sitemap.xml.gz
Sitemap: https://www.producthunt.com/sitemaps_v3/products_categories_sitemap.xml.gz
User-agent: SemrushBot
Crawl-delay: 1
User-agent: SiteAuditBot
Crawl-delay: 1
head
- title
- Product Hunt – The best new products in tech.
- description
- Product Hunt is a curation of the best new products, every day. Discover the latest mobile apps, websites, and technology products that everyone's talking about.
social
- og:title
- Product Hunt – The best new products in tech.
- og:description
- Product Hunt is a curation of the best new products, every day. Discover the latest mobile apps, websites, and technology products that everyone's talking about.
- og:url
- https://www.producthunt.com
- og:site_name
- Product Hunt
- og:locale
- en_US
- og:image
- https://ph-static.imgix.net/ph-logo-1.png?auto=format
- og:type
- article
- twitter:card
- summary_large_image
- twitter:site
- @producthunt
- twitter:title
- Product Hunt – The best new products in tech.
- twitter:description
- Product Hunt is a curation of the best new products, every day. Discover the latest mobile apps, websites, and technology products that everyone's talking about.
- twitter:image
- https://ph-static.imgix.net/ph-logo-1.png?auto=format