Skip to content
xPloits3cPublic

Latest commit

 

History

42 Commits

Folders and files

NameName
Last commit message
Last commit date
 
 
 
 
 
 
 
 
 
 

Repository files navigation

MetaByte

Clean and save unique URLs, emails, phone numbers and IPs.

MetaByte is a fast parsing script that extracts emails, phone numbers, IPv4 addresses and URLs from any text file, removes duplicates automatically and saves each data type in its own CSV file.

image


Table of Contents


Features

  • Automatic extraction of:
    • Emails
    • Phone numbers
    • IP addresses (IPv4, octets validated 0-255)
    • Full URLs (HTTP/HTTPS)
    • Full URLs with parameters, e.g. id=1, .php?catid=
  • Duplicate removal for every data type
  • Link removal: exclude unwanted sites or keywords (e.g. google.com, bing.com) using a blacklist file
  • Parameter filter for URLs (--filter id,token)
  • Results saved to separate CSV files
  • Multiple modes: email, phone, ip, url, urlparams, all

results_all


Installation

git clone https://github.com/xPloits3c/MetaByte.git
cd MetaByte
pip install -r requirements.txt

Requires Python 3 and colorama.


Usage

python3 metabyte.py -f <file.txt> -m <mode> [--remove <blacklist.txt>] [--filter <params>]

Modes

Mode Description
email Extracts email addresses only
phone Extracts phone numbers only
ip Extracts IP addresses only
url Extracts URLs only
urlparams Extracts URLs with parameters only
all Extracts everything

Options

Option Description
-f, --file Input file to analyze
-m, --mode Extraction mode (see table above)
--remove Text file with URLs or keywords to remove, one per line (url mode)
--filter Comma-separated parameter filters (urlparams mode), e.g. id,token
-h, --help Show the help message

Removing unwanted links

Create a text file with one URL or keyword per line:

google.com
bing.com
youtube.com

Any extracted URL containing one of these entries is discarded:

python3 metabyte.py -f urls.txt -m url --remove remove_links.txt

Examples

# Emails only
python3 metabyte.py -f emails.txt -m email

# URLs only
python3 metabyte.py -f atomicurls.txt -m url

# URLs, excluding the sites listed in remove_links.txt
python3 metabyte.py -f urls.txt -m url --remove remove_links.txt

# URLs with parameters, filtered by parameter name
python3 metabyte.py -f urls.txt -m urlparams --filter id,token

# Example with a PHP pattern
python3 metabyte.py -f urls.txt -m urlparams --filter .php?id

# Everything
python3 metabyte.py -f mixdata.csv -m all

mb_h


Output

Data is automatically saved to CSV files in the current directory:

File Content
email.csv Unique emails
phone.csv Unique phone numbers
ip.csv Unique IPv4 addresses
urls.csv Unique URLs
urls_with_params.csv Unique URLs with parameters

Credits


Roadmap

  • IPv6 support
  • JSON export
  • Graphical user interface (GUI)
  • Automatic scanning from folders

Releases

Packages

Used by

Contributors

Languages