Parsing SSH Logs - Basics
This is part two of four in a series of articles about security.
- Text Processing Tools in UNIX
- Parsing SSH Logs
- Configuring fail2ban
- Configuring mail (and Slack) for SSH Notifications
As a big fan of testing, I want to check whether or not adding additional security to EC2 instance is worth it or not. There is no point in adding anything if it will not be used. Hence, I started a experiment to see how much access a server on the Internet was really getting.
The test is: I am the only person accessing my EC2 instance.
In part one, I cover text processing tools in UNIX such as cat, |, grep, awk, wc, sort, uniq, and geoiplookup.
I will use these tools on an SSH log (
/var/log/auth.log in Ubuntu)
and found some interesting information about an openly accessible
server on the Internet. This has made me rethink server security.
Openly Accessible Server
For my experiment, I configured an openly accessible server, which I define as: a server that allows a connection from any IP address.
- Host: AWS
- Operating System: Ubuntu 14.04
- Accessible port: 22 (default for SSH protocol)
The address was not attached to any DNS system (i.e. No-IP) or its address posted anywhere. The server is just a silent server on the Internet in an ocean of servers…
The SSH logs are available
it is also the same
auth.log used in code samples in this article.
Items covered from the log in this article
- log stats
- successful logins
- login attempts
The log started from Jan 11, 2017 and Feb 4, 2017, for a period of approximately 24 days.
Number of log entries
The number of log entries can be easily obtained using:
The total lines in the log: 52,357. As this is not an enormous amount of data, it is enough to be annoying to process by hand, but not enough to warrant writing (and testing!) a program, especially when there are excellent tools in UNIX.
The number of log entries generated from cron (a UNIX utility which performs commands a scheduled intervals):
cron generated 1,676 entries.
The number of log entries generated by the ssh daemon (the main point of access to this server):
sshd generated 50,569 entries.
Number of log entries generated by sudo:
sudo generated 98 entries, for every sudo action I performed while logged in.
So, each time a normal user logged in, there was 98 sudo actions performed. This is interesting to see sudo actions are logged in ssh’s logs.
The next section there are some stats about logging in. This is important to understand how successful logins are recorded will help when understanding login attempts from others.
The number of successful logins:
The server only had seven successful logins over 24 days. They are all from me as I did not create any other users for the system.
note: cron also opens a session for root to perform scheduled actions.
The number of different IP addresses which had successful logins:
Port scanning is a common method to check what system services are running by checking if a port is open. It can be used by system owners to check their server, or by attackers to find vulnerabilities.
Port scanners usually connect to a port and immediately disconnect. This connection type is recorded in the log as: ‘Received disconnect’, like so:
The number of port scanning attempts detected:
A total of 14,578 scans were performed in a period of 24 days. To put that in perspective, the system had 25 scans per hour (14,578 scans/(24 days * 24 hours/day)).
The number of individual IPs that did port scanning:
From this point, I will use ‘attacker’ as any IP address trying to access the server that were not successful.
A total of 156 different attackers performed port scanning on the server in 24 days, which means each attacker did approximately 93 scans each (14,578 scans/156 attackers).
The number of port scans done by each attacker:
The top 5 port scanning attacker:
|# of scans||Attacker|
It’s not that each attacker did 93 port scans each, it seems very few attackers performed a LOT of port scans. The top two attackers accounted for about 33% of the total port scans done.
The number of login attempts made:
11,657 login attempts were made in a period of 24 days, which is about 20 attempts per hour (11,657 attempts / (24 days * 24 hours per day)).
The number of different usernames used in login attempts;
A total of 1,692 different usernames were used for attempted logins.
The most frequently used login name:
|# of attempts||username|
These all seem like standard server user name for various services
(i.e. postgres => postgresql database)
while the most interesting is:
ubnt. The standard login name for an
Ubuntu system is
ubuntu. I really wonder why there were so many
Interestingly, the number of times
ubuntu was used as a username for
an attempted login:
Zero. I think the detected operating system may have thrown off a lot of attackers, as the online scanner detected the operating system to not be Ubuntu:
The scan was definitely right the operating system was Linux.
Test result: I am not the only one accessing my EC2 instance.
There have been an overwhelming amount of accesss found in ssh log. SSH login with PGP keys are very secure, but it’s unweildly to know how many attackers are even trying to access the server.
Next time, I will parse the log to find how many times SSH defended itself and physically find where the majority of attacks are coming from using geoiplookup.