Инструменты OSINT. Ющук Евгений Леонидович. Конкурентная разведка.

Инструменты OSINT от Github

OSINT Ющук Евгений Конкурентная разведка

A curated list of amazingly awesome open source intelligence tools and resources. Open-source intelligence (OSINT) is intelligence collected from publicly available sources. In the intelligence community (IC), the term "open" refers to overt, publicly available sources (as opposed to covert or clandestine sources)

📖 Table of Contents

↑ Contributing

Please read CONTRIBUTING if you wish to add tools or resources.

↑ Credits

This list was taken partially taken from i-inteligence's OSINT Tools and Resources Handbook.

Thanks to our main contributors jivoi EK_ spmedia

↑ General Search

The main search engines used by users.

Advangle
Aol
Ask
Bing
DuckDuckGo - an Internet search engine that emphasizes protecting searchers' privacy.
Gigablast
Goodsearch
Google Search - Most popular search engine.
Instya
Impersonal.me
iSEEK Education
ixquick
Lycos
Parseek (Iran)
Search.com
SurfCanyon
Teoma
Wolfram Alpha
Yahoo! Search -

↑ Main National Search Engines

Localized search engines by country.

Alleba (Philippines) - Philippines search engine
Baidu (China) - The major search engine used in China
Eniro (Sweden)
Goo (Japan)
Najdsi (Slovenia)
Naver (South Korea)
Onet.pl (Poland)
Orange (France)
Parseek (Iran)
SAPO (Portugal)
Search.ch (Switzerland)
Walla (Israel)
Yandex (Russia)

↑ Meta Search

Lesser known and used search engines.

↑ Specialty Search Engines

Search engines for specific information or topics.

↑ Visual Search and Clustering Search Engines

Search engines that scrape multiple sites (Google, Yahoo, Bing, Goo, etc) at the same time and return results.

Carrot2 - Organizes your search results into topics.
Yippy - Search using multiple sources at once

↑ Similar Sites Search

Find websites that are similar. Good for business competition research.

Google Similar Pages
SimilarSites - Discover websites that are similar to each other
SitesLike - Find similar websites by category

↑ Document and Slides Search

Search for data located on PDFs, Word documents, presentation slides, and more.

↑ Pastebins

Find information that has been uploaded to Pastebin.

PasteLert - PasteLert is a simple system to search pastebin.com and set up alerts (like google alerts) for pastebin.com entries.

↑ Code Search

Search by website source code

NerdyData - Search engine for source code.
SearchCode - Help find real world examples of functions, API's and libraries across 10+ sources.

↑ Major Social Networks

↑ Real-Time Search, Social Media Search, and General Social Media Tools

Social Media Tools

↑ Twitter

↑ Facebook

↑ Instagram

↑ Pinterest

Pingroupie

↑ Reddit

Tools to help discover more about a reddit user or subreddit.

Imgur - The most popular image hosting website used by redditors.
Mostly Harmless - Mostly Harmless looks up the page you are currently viewing to see if it has been submitted to reddit.
Reddit Archive - Historical archives of reddit posts.
Reddit Suite - Enhances your reddit experience.
Reddit Investigator - Investigate a reddit users history.
Reddit Metrics - Keeps track of the growth of a subreddit.
Reddit User Analyser - reddit user account analyzer.
SnoopSnoo - Provides reddit user and subreddits analytics.
Subreddits - Discover new subreddits.
Reddit Comment Search - Analyze a reddit users by comment history.

↑ VKontakte

Perform various OSINT on Russian social media site VKontakte.

Дезертир
Barkov.net
Report Tree
Social Stats
Snradar - Search pictures by time and location they were taken
Target Hunter
Target Log
VK5
VK Community Search
VK Parser - A tool to search for a target audience and potential customers.
VK People Search
VK to RSS Appspot

↑ Tumblr

Tumblr Search

↑ LinkedIn

FTL - Browser plugin that finds emails of people's profiles in LinkedIn.

↑ Blog Search

BlogSearchEngine
Icerocket
Notey - Blog post search engine.
Sphere
Twingly

↑ Forums and Discussion Boards Search

↑ Username Check

Check User Names
Knowem - Search for a username on over 500 popular social networks.
Name Chk
Name Checkr
Name Checkup
User Search

↑ People Investigations

411 (US)
192 (UK)
Alumni.net
Ancestry
Canada411
Cedar
Charlie App
Classmates
CrunchBase
CVGadget
Data 24-7
facesearch - Search for images of a person by name.
Family Search
Family Tree Now
Federal Bureau of Prisons - Inmate Locator (US) - Find an inmate that is in the Federal Bureau of Prisons system.
Fold3 (US Military Records) - Browse records of US Military members.
Genealogy Bank
Genealogy Links
Hey Press (Search for Journalists)
Homemetry
Infobel
Interment
International White and Yellow Pages
Itools
Kompass
LookUpUK
Lullar
MarketVisual
MelissaDATA
My Life People Search
The National Archives (UK)
PeekYou
People Search (Australia)
PeopleSearch.net
Pipl
Rapportive
RecordsPedia
Recruitem
Reunion
Rootsweb
SearchBug
Skip Ease
Smart Background Checks
snitch.name
SnoopStation
Spokeo
Switchboard
That’sThem
USSearch
WebMiii
White Pages (US)
Wink
Yasni
Zabasearch
Zoominfo

↑ E-mail Search / E-mail Check

BriteVerify Email Verification
DeHashed - DeHashed helps prevent ATO with our extensive data set & breach notification solution. Match employee and consumer logins against the world’s largest repository of aggregated publicly available assets leaked from third-party breaches. Secure passwords before criminals can abuse stolen information, and protect your enterprise.
Email Address Validator
Email Format
EmailHippo
Email Permutator+
EmailSearch.net
Email Validator
h8mail - Password Breach Hunting and Email OSINT, locally or using premium services. Supports chasing down related email
Have I Been Pwned - Search across multiple data breaches to see if your email address has been compromised.
Hunter - Hunter lets you find email addresses in seconds and connect with the people that matter for your business.
MailTester
Peepmail
Pipl
ReverseGenie
TCIPUTILS.com Email Test
ThatsThem
Toofr
Verify Email
VoilaNorbert - Find anyone's contact information for lead research or talent acquisition.

↑ Phone Number Research

National Cellular Directory - was created to help people research and reconnect with one another by performing cell phone lookups. The lookup products includes have billions of records that can be accessed at any time, as well as free searches one hour a day, every day.
Reverse Phone Lookup - Detailed information about phone carrier, region, service provider, and switch information.
Spy Dialer - Get the voicemail of a cell phone & owner name lookup.
Twilio - Look up a phone numbers carrier type, location, etc.
Phone Validator - Pretty accurate phone lookup service, particularly good against Google Voice numbers.

↑ Expert Search

↑ Company Research

↑ Job Search Resources

↑ Q&A Sites

↑ Domain and IP Research

Accuranker
ahrefs - A tool for backlink research, organic traffic research, keyword research, content marketing & more.
Alexa
Bing Webmaster Tools
BuiltWith
Central Ops
Dedicated or Not
DNSDumpster
DNS History
DNSStuff
DNSViz
Domain Big Data
Domain Crawler
Domain Dossier
Domain History
Domain Tools - Whois lookup and domain/ip historical data.
Easy whois
Exonera Tor - A database of IP addresses that have been part of the Tor network. It answers the question whether there was a Tor relay running on a given IP address on a given date.
Follow.net
GraphyStories
HypeStat
Infosniper
intoDNS
IP Checking
IP Location
IP 2 Geolocation
IP 2 Location
IPFingerprints
IPVoid - IP address toolset.
IntelliTamper
Kloth
NetworkTools
Majestic
MaxMind
MXToolbox - MX record lookup tool.
Netcraft Site Report
OpenLinkProfiler
Open Site Explorer
PageGlimpse
Pentest-Tools.com
PhishStats
Pulsedive
Quantcast
Quick Sprout
RedirectDetective
Remote DNS Lookup
Robtex
Spyse - Scans entire internet using OSINT and collects all valuable info in its own database: Ipv4 hosts, domains/Meta/Whois, AS, TLS/SSL, Ports/Banners/Protocols, technologies, OS and much other info.
SameID
SecurityTrails - API to search current and historical DNS records, current and historical WHOIS, technologies used by sites and whois search for phone, email, address, IPs etc.
SEMrush
SEO Chat Tools
SEOTools for Excel
Similar Web - Compare any website traffic statistics & analytics.
SmallSEOTools
StatsCrop
Squatm3gator - Enumerate available domains generated modifying the original domain name through different cybersquatting techniques
TCPIPUTILS.com
urlQuery
URLVoid - Analyzes a website through multiple blacklist engines and online reputation tools to facilitate the detection of fraudulent and malicious websites.
Wappalyzer
WebMeUp
Website Informer
WhatIsMyIPAddress
Who.is - Domain whois information.
Whois Arin Online
WhoIsHostingThis
WhoisMind
Whoisology
WhoIsRequest
w3snoop
Verisign
ViewDNS.info
You Get Signal

↑ Keywords Discovery and Research

Google Adwords - Get monthly keyword volume data and stats.
Google Trends - See how many users are searching for specific keywords.
Keyword Discovery
Keyword Spy
KeywordTool
One Look Reverse Dictionary
Word Tracker
Soovle
Ubersuggest

↑ Web History and Website Capture

Archive.is
BlackWidow
CashedPages
CachedView
Screenshots.com
Wayback Machine - Explore the history of a website.
Wayback Machine Archiver

↑ Language Tools

2lingual
Apertium
Babelfish
Bablic
Bing Translator
Dict.cn
Dictionary.com: Translation
FreeTranslation
Free Translator
Free Website Translation
Frengly
Gengo
Google Input Tools - Makes it easy to type in the language you choose, anywhere on the web.
Google Translate
Google Tranlslate Extension
IdiomaX Translation
India Typing
imTranslator
iTranslate
iTranslate Voice
Lexicool Translation
Linguee
LingvoSoftOnline
Microsoft Translator
Noslang
OdysseyTranslator
Pleco
PROMT-Online
Reddit/r/translator
Reverso
Slangit
Systran
Translate.com
Unbabel
WorldLingo
WorldReference.com
Yamli (Arabic Search Engine)
Yandex Translate

↑ Image Search

↑ Image Analysis

↑ Stock Images

↑ Video Search and Other Video Tools

Aol Videos
Bing Videos
Blinkx
Clarify
Clip Blast
DailyMotion
Deturl
DownloadHealper
Earthcam
Frame by Frame - Browser plugin that allows you to watch YouTube videos frame by frame.
Geosearch
Internet Archive: Open Source Videos
LiveLeak
Metacafe
Metatube
Montage
Veoh
Vimeo
Voxalead
Yahoo Video Search
YouTube
YouTube Data Viewer
ccSUBS - Download Closed Captions & Subtitles from YouTube

↑ Radio and Podcasts Tools

↑ Academic Resources and Grey Literature

Academia
Academic Journals
African Journal Online
American Society of Civil Engineers
Base
Bibsonomy
Cambridge Journals
The Collection of Computer Science Bibliographies - The CCSB is a collection of bibliographies of scientific literature in computer science from various sources, covering most aspects of computer science.
Core
Elsevier
Google Scholar
Grey Guide
Grey Literature (HLWIKI International)
Grey Literature – List of Gateways
Grey Literature Report
Grey Literature Strategies
GreyNet International
HighWire: Free Online Full-text Articles
Journal Guide
Journal Seek
JSTOR - Search over 10 million academic journal articles, books, and primary sources.
Lazy Scholar
Leibniz Information Centre For Science and Technology University Library - indexes all reports of German publicly funded projects and many scientific papers.
Microsoft Academic
NRC Research Press
Open Access Scientific Journals
Open Grey
The Open Syllabus Project
Oxford Journals
PubMed - Search more than 27 millions citations for biomedical literature from MEDLINE, life science journals, and online books.
Quetzal Search
Research Gate
SAGE Journals
ScienceDirect
SCIRP
Springer
ScienceDomain
Science Publications
Taylor & Francis Online
Wiley
World Digital Library
World Science
Zetoc

↑ Books and Reading

↑ Geospatial Research and Mapping Tools

↑ News

↑ News Digest and Discovery Tools

↑ Fact Checking

About Urban Legends
Captin Fact
Check
Citizen Desk
Emergent
Fact Check
Full Fact
MediaBugs
Snopes - The definitive Internet reference source for urban legends, folklore, myths, rumors, and misinformation.
Verification Handbook
Verification Junkie
Verily

↑ Data and Statistics

↑ Web Monitoring

Alltop
Awasu
Bridge.Leslibres
Bridge.Suumitsu
ChangeDetect
ChangeDetection
Deltafeed
DiggReader
Feed43
FeedBooster
Feederator
Feed Exileed
Feed Filter Maker
Feedly
FeedReader
FetchRSS
Flipboard
FollowThatPage
Google Alerts - A content change detection and notification service.
InfoMinder
IQAlerts
Mention
Netvibes
Newsblur
NewsRSSTicker
OmeaReader
OnWebChange
Reeder
RSS Bridge
RSS Feed Reader
RSS Micro
RSS Search Engine
RSS Search Hub
RSSOwl
RSS Subscription Extension
Selfoss
Silobreaker
Talkwalker
The Old Reader
versionista
visualping
WebReader
WebSite Watcher
Winds

↑ Bookmarking

↑ Startpages

↑ Browsers

Brave
CentBrowser
Chrome
Comodo Dragon
Coowon
Edge
Firefox
Maxthon
Opera
Safari
Sleipnir
Slimjet
SRWare Iron
Tor Browser - Tor is a free software that prevents people from learning your location or browsing habits by letting you communicate anonymously on the Internet.
Torch
UCBrowser
Vivaldi
Yandex Browser

↑ Offline Browsing

A1 Website Download - Download entire websites to disk.
Cyotek WebCopy
gmapcatcher
Hooey webprint
HTTrack - Allows you to download a World Wide Web site from the Internet to a local directory, building recursively all directories, getting HTML, images, and other files from the server to your computer.
Offliberty
Resolver
SiteSucker
WebAssistant
Website Ripper Copier

↑ VPN Services

↑ Note-taking

↑ Annotation Tools

↑ Writing and Office Tools

↑ Slide Show and Presentation Tools

Canva
Convert Words to Time - Converts the number of words in a presentation or speech to how many minutes it will take to read.
Deckset
emaze
GoogleDocs
Haiku Deck
Keyonote
KingSoft
KnowledgeVision
LibreOffice
Live Slides
Mighty Meeting
Movenote
MS Office
MySlidePresenter
Powtoon
Presentation Next
presenterswall
Prezi
Slidedog
Slideidea
SlidePresenter
SlideRocket
Slides
SpeechInMinutes
Sway
vcasmo
Visme
Zoho Docs

↑ Digital Publishing

↑ Newsletter Tools

↑ Digital Storytelling

↑ Infographics and Data Visualization

↑ Image and Photo Editing

↑ Productivity Tools

↑ E-mail Management

ActiveInbox
AutoHotkey
Batched Inbox
Baydin
Block Sender
Boomerang Mail
ClearContext
Cleanfox
CloudMagic
Complete
FindBigMail
Followupthen
Hiver
Integrated gmail
Mailstore
Hubspotsales
Minimalist
NudgeMail
Rapportive
Sanebox
Send for Gmail
Sortd
Ugly Email
Unroll.me - Easily unsubscribe in one click from email subscriptions.
Wisestamp

↑ Document and Reference Management

Colwiz
DocumentCloud
Endnote
F1000
Investigative Dashboard Search
ManualsLib - Database of More Than 2.6M Manuals.
Mendeley
Omnity
Overview
Papers
Readcube
RefME
Zotero

↑ PDF Management

↑ OCR Tools

↑ Cloud Storage and File Sharing

↑ Web Automation

↑ Dashboard Tools

↑ Wikis

↑ Collaboration and Project Management

10kinsights
15Five
92fiveApp
5pm
ActionMint
ActiveCollab
Advanseez
Agilewords
Agilezen
AllThings
Any.do
Apollo
Asana
Authorea
AWW
Azendoo
Basecamp
Binfire
Breeze
Canvanizer
Casual
Cardboardit
Cardsmith - Build visual collaboration systems with the familiarity of sticky notes on a white board.
CloudApp
Cnverg
Collabtive
CollaborateCloud
Comindwork
Conceptboard
Confluence
CoSketch
Crowdbase
Dayboard
Deekit
Draw.to
eGroupWare
Elegantt
Encrypted Cloud
Firepad
Firesub
Flask
Float
Flockdraw
Flow
Frame
Freedcamp
GetDoneDone
Glasscubes
GQueues
GroupZap
Hightail
hitask
Huddle
KabanTool
Kanboard
Kerika
Linky dink
Listacular
Loomio
LumoFlow
Mammoth
MyKanzen
Nozbe
Nutcache
Minute
Mural
OmniGroup
OnlyOffice
Padlet
Piematrix
Pinstriped
PivotalTracker
Plan
Planleaf
Planzone
Podio
PrimaryPad
ProjectManager
ProjectPlace
ProofHub
Quip
Quire
Realtimeboard
Redbooth
Restya
Reverb
ScadaPlan
Scribblar
SeavusProjectViewer
Smartsheet
Stackfield
Stormboard
Sync.in
SyncSpace
Taiga
TargetProcess
Taskboard
TeamAllocator
Team.fm
Teamgum
Team Pad
TeamWork
TeamWorklive
TitanPad
~~Todoyu~~ - Original project discontinued - now maintained at Todoyu-PHP7.x
Transparent Business
Trello
Tuzzit
Twiddla
Twoodo
updatey
Web Whiteboard
Weekdone
Wekan
wePaste
Whiteboard
Whiteboard
Whiteboard Fox
Worknoard
Workfront
Wrike
Yammer
YouTrack
Zoho

↑ Communication Tools

↑ Calendars and Scheduling

↑ Mind Mapping, Concept Mapping and Idea Generation Tools

↑ Social Network Analysis

↑ Privacy and Encryption Tools

↑ DNS

Amass - The amass tool searches Internet data sources, performs brute force subdomain enumeration, searches web archives, and uses machine learning to generate additional subdomain name guesses. DNS name resolution is performed across many public servers so the authoritative server will see the traffic coming from different locations. Written in Go.
findsubdomains - Automatically scans different sources to collect as many subdomains as can. Validate all the data through various tools and services to provide correct results without waiting.

↑ Other Tools

Barcode Reader - Decode barcodes in C#, VB, Java, C\C++, Delphi, PHP and other languages.
Belati - Belati - The Traditional Swiss Army Knife For OSINT. Belati is tool for Collecting Public Data & Public Document from Website and other service for OSINT purpose.
Datasploit - Tool to perform various OSINT techniques on usernames, emails addresses, and domains.
Greynoise - "Anti-Threat Intelligence" Greynoise characterizes the background noise of the internet, so the user can focus on what is actually important.
- pygreynoise - Greynoise Python Library
The Harvester - Gather emails, subdomains, hosts, employee names, open ports and banners from different public sources like search engines, PGP key servers and SHODAN computer database.
Intrigue Core - Framework for attack surface discovery.
Maltego - Maltego is an open source intelligence (OSINT) and graphical link analysis tool for gathering and connecting information for investigative tasks.
OpenRefine - Free & open source power tool for working with messy data and improving it.
Orbit - Draws relationships between crypto wallets with recursive crawling of transaction history.
OSINT Framework - Web based framework for OSINT.
OsintStalker - Python script for Facebook and geolocation OSINT.
Outwit - Find, grab and organize all kinds of data and media from online sources.
eScraper - Grab product descriptions, prices, image urls and other data effortlessly
Photon - Crawler designed for OSINT
Pown Recon - Target reconnaissance framework powered by graph theory.
QuickCode - Python and R data analysis environment.
SecApps Recon - Information gathering and target reconnaissance tool and UI.
sn0int - Semi-automatic OSINT framework and package manager.
Zen - Find email addresses of Github users

↑ Threat Intelligence

REScure Threat Intel Feed - REScure is an independent threat intelligence project which we undertook to enhance our understanding of distributed systems, their integration, the nature of threat intelligence and how to efficiently collect, store, consume, distribute it.
OTX AlienVault - Open Threat Exchange is the neighborhood watch of the global intelligence community. It enables private companies, independent security researchers, and government agencies to openly collaborate and share the latest information about emerging threats, attack methods, and malicious actors, promoting greater security across the entire community.
Digital Stakeout - DigitalStakeout Scout™ is the leading security intelligence tool to collect data from the surface web, social media, dark web and technical sources to illuminate and investigate external threats.