Spam filter optimality based on signal detection theory
Authors: 
Singh Kuldeep, J�sang Audun, Md. Sadek Ferdous, Ravishankar BorgaonkarAuthors Info & Claims
Singh Kuldeep, J�sang Audun, Md. Sadek Ferdous, Ravishankar BorgaonkarAuthors Info & ClaimsPages 219 - 224
Abstract
Unsolicited bulk email, commonly known as spam, represents a significant problem on the Internet. The seriousness of the situation is reflected by the fact that approximately 97% of the total e-mail traffic currently (2009) is spam. To fight this problem, various anti-spam methods have been proposed and are implemented to filter out spam before it gets delivered to recipients, but none of these methods are entirely satisfactory. In this paper we analyze the properties of spam filters from the viewpoint of Signal Detection Theory (SDT). The Bayesian approach of Signal Detection Theory provides a basis for determining the optimality of spam filters, i.e. whether they provide positive utility to users. In the process of decision making by a spam filter various tradeoff's are considered as a function of the costs of incorrect decisions and the benefits of correct decisions.
References
[1]
Security intelligence. Technical report, Microsoft, December 2008.
[2]
H. Abdi. Signal detection theory (sdt) overview.
[3]
A.R. Agustin Orfila, Javier Carbo. Decision model analysis for spam. Information and Security: An International Journal, 15(2):151--161, 2004.
[4]
G.P.F.R. Andre Bergholz, Jeong-Ho Chang and S. Strobel. Improved phishing detection using model-based features. In Fifth Conference on Email and Anti-Spam. CEAS, August 2008.
[5]
I. Androutsopoulos, J. Koutsias, K.V. Ch, G. Paliouras, and C.D. Spyropoulos. An evaluation of naive bayesian anti-spam filtering. In Proceedings of the workshop on Machine Learning in the New Information Age, G. Potamias, V. Moustakis and M. van Someren (eds.), 11th European Conference on Machine Learning, pages 9--17, 2000.
[6]
A. Cournane and R. Hunt. An analysis of the tools used for the generation and prevention of spam.
[7]
M.A. Dyrud. "i brought you a good news": An analysis of nigerian 419 letters. In Proc. of the 2005 Association for Business Communication Annual Convention, 2005.
[8]
F.D. Garcia, J. henk Hoepman, and J.V. Nieuwenhuizen. Spam filter analysis. In Proceedings of 19th IFIP International Information Security Conference, WCC2004-SEC, pages 395--410. Kluwer Academic Publishers, 2004.
[9]
D.M. Green and J.A. Swets. Signal Detection Theory and Psychophysics. Peninsula Publishing, 1966.
[10]
D. Heeger. Signal detection theory. Technical report, November 1997. Available at: http://www.cns.nyu.edu/~david/handouts/sdt-advanced.pdf.
[11]
A. Jsang and S. Pope. User centric identity management. In in Asia Pacific Information Technology Security Conference, AusCERT2005, Austrailia, pages 77--89, 2005.
[12]
S. Mikko and S. Carl. Effective anti-spam strategies in companies: An international study. In HICSS '06: Proceedings of the 39th Annual Hawaii International Conference on System Sciences, page 127.3, Washington, DC, USA, 2006. IEEE Computer Society.
[13]
M. Sahami, S. Dumais, D. Heckerman, and E. Horvitz. A bayesian approach to filtering junk e-mail. In AAAI Workshop on Learning for Text Categorization, July 1998.
[14]
S. Shirali-Shahreza and A. Movaghar. A new anti-spam protocol using captcha. pages 234--238, April 2007.
[15]
T.D. Wickens. Elementary Signal Detection Theory. Oxford University Press (OUP), 2001.
Index Terms
- Spam filter optimality based on signal detection theory
Recommendations
DNS Resource Record Analysis of URLs in E-Mail Messages for Improving Spam Filtering
SAINT '11: Proceedings of the 2011 IEEE/IPSJ International Symposium on Applications and the InternetIn recent years, spam mails intending for ``One-click fraud" or ``Phishing" have become increasing. As one anti-spam technology, DNSBL based on the URLs or their corresponding IP addresses in the messages is well used. However, some spam mails that ...
An ensemble approach applied to classify spam e-mails
Spam e-mails, known as unsolicited e-mail messages, have become an increasing problem for information security. The intrusion of spam e-mails persecute the users and waste the network resources. Traditionally, machine learning and statistical filtering ...
Filtering spam with behavioral blacklisting
CCS '07: Proceedings of the 14th ACM conference on Computer and communications securitySpam filters often use the reputation of an IP address (or IP address range) to classify email senders. This approach worked well when most spam originated from senders with fixed IP addresses, but spam today is also sent from IP addresses for which ...
Comments
Information & Contributors
Information
Published In
October 2009
322 pages
ISBN:9781605584126
DOI:10.1145/1626195
- General Chairs:
- Atilla El�i,
- Oleg Makarevich,
- Mehmet Orgun,
- Program Chairs:
- Alexander Chefranov,
- Josef Pieprzyk,
- Yuri Anatolievich Bryukhomitsky,
- Sıddıka Berna Örs
Copyright © 2009 ACM.
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]
Sponsors
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 06 October 2009
Check for updates
Author Tags
Qualifiers
- Research-article
Conference
SIN '09
Sponsor:
SIN '09: 2nd International Conference of Security of Information and Networks
October 6 - 10, 2009
Famagusta, North Cyprus
Acceptance Rates
Overall Acceptance Rate 102 of 289 submissions, 35%
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 237Total Downloads
- Downloads (Last 12 months)2
- Downloads (Last 6 weeks)0
Reflects downloads up to 16 Oct 2024
Other Metrics
Citations
View Options
Get Access
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in