Abuse Reporting: Difference between revisions

From ASRG
Jump to navigationJump to search
(→‎The Feedback Loop (FBL) and other usage: Add image and explanation)
(→‎The Feedback Loop (FBL) and other usage: title, wording, punctuation)
Line 17: Line 17:
See also the Wikipedia [http://en.wikipedia.org/wiki/Feedback_Loop_%28email%29 page].
See also the Wikipedia [http://en.wikipedia.org/wiki/Feedback_Loop_%28email%29 page].


==The Feedback Loop (FBL) and other usage==
==The Feedback Loop (FBL) and other usage of abuse reports==
Huge mailbox providers may provide a means for ESPs to get abuse reports issued for messages that had been sent by themselves. This tool can be used to automate opt-out. The sender should tag each message, setting an opaque token and possibly signing it, so as to be able to retrieve necessary submission details.
Huge mailbox providers may provide a means for ESPs to get abuse reports issued for messages that had been sent by themselves. This tool can be used to automate opt-out. The sender should tag each message, setting an opaque token and possibly signing it, so as to be able to retrieve necessary submission details.


Another use of abuse reports is to tune an MX server's spam filter. For Bayesian filters this requires a spam/ham indicator. Some hosts automatically convert reports into unsubscribe requests when the reported message contained a ''List-Unsubscribe'' header field.
Another use of abuse reports is to tune an MX server's spam filter. For Bayesian filters this requires a spam/ham indicator. Some hosts automatically convert reports into unsubscribe requests when the reported message contained a ''List-Unsubscribe'' header field.


[[Image:Abuse-report-flow.png|thumb|right|350px|Hypothetical path of an abuse report (green) after submission.]] A DSN may be a [[MIME]]
[[Image:Abuse-report-flow.png|thumb|right|350px|Hypothetical usage of an abuse report (green) submitted in response to a spam message (violet).]]  
While it is felt that proper use of abuse reports may result in reliable reputation recording, how abuse reports should be routed is still a debatable question. Rough consensus indicates that users should send abuse reports to their mailbox providers. FBLs as operated, e.g., by [http://returnpath.net/ ReturnPath], are not scalable and may be questionable from a privacy point of view. The [http://abusix.org/ Abusix] approach provides for routing abuse reports hierarchically, through top level IP assignments. The image beside depicts possible use:
While it is felt that proper use of abuse reports may result in reliable reputation recording, how abuse reports should be routed is still a debatable question. Rough consensus indicates that users should send abuse reports to their mailbox providers. FBLs as operated, e.g., by [http://returnpath.net/ ReturnPath], are not scalable and may be questionable from a privacy point of view. The [http://abusix.org/ Abusix] approach provides for routing abuse reports hierarchically, through top level IP assignments. The image beside depicts possible use:


# tuning filters at the 1st MX (assuming it is on the ''recipient side'');
# Tuning filters at the 1st MX, assuming it is on the ''recipient side''. The 1st MX can be identified as ''responsible for receiving'', e.g. by authentication results.
# let the spammer's MSA punish the spammer;
# Let the spammer's MSA suppress further attempts; this step is useless and questionable if the MSA is directly operated by the spammer. The MSA can be identified as ''responsible for sending'', e.g. by author signatures.
# arguably connection providers should terminate contracts with blatantly spamming MSAs --the relevant provider's abuse-box may be obtained looking up Abusix's database;
# Arguably, connection providers should terminate contracts with blatantly spamming MSAs. The connection provider can be identified via RIR whois; Abusix's database provides abuse-box lookup by IP address.
# reputation trackers should verify if the MSA blocks the spammer.
# Reputation trackers should verify whether the MSA actually blocks the spammer.
 
<br style="clear:both" />
<br style="clear:both" />



Revision as of 11:44, 15 December 2009

Anti-spam technique: Abuse Reporting
Date of first use: Before 2003
Effectiveness: ?
Popularity: Medium
Difficulty of implementation: ?
Where implemented: External
Harm: ?


Abuse Reporting is a cooperative technique whereby spam is suppressed at the origin by the administrators of an MSA. Mail domains' reputation can be preserved by limiting outgoing spam, thus operators are motivated to suppress spamming. Probably the earliest anti-spam defense, this technique relies on end users to submit abuse reports timely and correctly. It is supported by huge mailbox providers, who feature a This is Spam (TiS) button on their web-based mail clients.

Abuse Reporting Format (ARF)

The format for transmitting abuse reports is going to be standardized. See abuse-feedback-report list.

See also the Wikipedia page.

The Feedback Loop (FBL) and other usage of abuse reports

Huge mailbox providers may provide a means for ESPs to get abuse reports issued for messages that had been sent by themselves. This tool can be used to automate opt-out. The sender should tag each message, setting an opaque token and possibly signing it, so as to be able to retrieve necessary submission details.

Another use of abuse reports is to tune an MX server's spam filter. For Bayesian filters this requires a spam/ham indicator. Some hosts automatically convert reports into unsubscribe requests when the reported message contained a List-Unsubscribe header field.

Hypothetical usage of an abuse report (green) submitted in response to a spam message (violet).

While it is felt that proper use of abuse reports may result in reliable reputation recording, how abuse reports should be routed is still a debatable question. Rough consensus indicates that users should send abuse reports to their mailbox providers. FBLs as operated, e.g., by ReturnPath, are not scalable and may be questionable from a privacy point of view. The Abusix approach provides for routing abuse reports hierarchically, through top level IP assignments. The image beside depicts possible use:

  1. Tuning filters at the 1st MX, assuming it is on the recipient side. The 1st MX can be identified as responsible for receiving, e.g. by authentication results.
  2. Let the spammer's MSA suppress further attempts; this step is useless and questionable if the MSA is directly operated by the spammer. The MSA can be identified as responsible for sending, e.g. by author signatures.
  3. Arguably, connection providers should terminate contracts with blatantly spamming MSAs. The connection provider can be identified via RIR whois; Abusix's database provides abuse-box lookup by IP address.
  4. Reputation trackers should verify whether the MSA actually blocks the spammer.


Adding a spam button to MUAs

Difficulties stem from the fact that a user may have multiple mailbox providers, which rules out single-address configurations[1].

The possibility that reports are cascaded back to the spammer may be considered a potential hazard that exposes the reporters and allows list washing[2]. However, it has been pointed out that spammers are not interested in feedback and don't bother[3]. There is also concern that a button might cause a flood of unwanted messages[2], specially when multiple targets can be determined.

Message's header based approach

An MX server may embed an header field indicating the address where abuse reports may be sent. If the MX doesn't support such field, MUAs may use the field provided by the sender, if any. Otherwise, MX operators may override that by removing the field, or by replacing it with their own FBL reporting address instead.[4]

Reusing existing field has also been proposed: the topmost Received[2], any Delivered-To, VBR-Info, or any trusted Authentication-Results. The latter one already requires users to confirm that they trust the relevant authserv-id, thereby clearing that hazard concern[5]. Fields with multiple values allow for multiple targets, which may be needed for forwarded messages in case abuse reports are used to tune spam filters. In addition, using a DNS RR to store one or more addresses allows even more flexibility: verifying that the service is actually supported, using addresses other than abuse@, and directly sending copies to reputation providers seem valid demands that a DNS call can fulfill.

Client's protocol based approach

Setting up an IMAP folder for this purpose has the advantage of requiring no special software on clients. This is in facts the most common solution for servers that maintain per-user Bayesian data, although it may be difficult to interpret users' intent in a non-interactive environment, and notwithstanding possible confusion or conflict with junk folders maintained by the client. When the SUBMIT and IMAP servers coincide, sending the report can be optimized by using BURL or similar techniques.

POP clients have no folders, hence they'd need special machinery, such as a new command to upload an abuse report or to retrieve the address where it should be sent[1].

References

  1. 1.0 1.1 John R. Levine Adding a spam button to MUAs Wed, 9 Dec 2009 00:35:03 -0500.
  2. 2.0 2.1 2.2 BOBOTEK, ALEX (ATTCINW) Re:... Tue, 8 Dec 2009 23:08:56 -0800.
  3. der Mouse Re:... Wed, 9 Dec 2009 21:47:12 -0500 (EST).
  4. Steve Atkins Re:... Tue, 8 Dec 2009 22:00:50 -0800.
  5. Alessandro Vesely Re:... Wed, 09 Dec 2009 12:32:49 +0100.