Your right to punch ends at my nose.  Who originally said it, and what
was the context

Dear Lives in Oregon, 

Most sources I found, who attribute the quote to someone, attribute
the original quote to Justice Oliver Wendell Holmes, who supposed to
have said "The right to swing my fist ends at the point of another
person's nose" (Supreme Court Justices apparently don't use vulgar
words such as "punch". It is also interesting to note, that while most
adaptations and alterations of this quote use the term "YOUR right to
... ends where MY nose begins", while Holmes is quoted to have
referred to self-limitation of one's rights, in order not to hurt
others, and not vice versa).

However, I must concede, that although the quote is commonly quoted in
reference to Holmes, I have found it in none of his speeches, books or
decisions. It could be a common wisdom attributed to the Judge.

I hope this answered your question. I have searched the web
extensively for this not-so-definite answer:
- All of the results containing your quote as well as the variations
on it
- All of the results referring to Justice Holmes

If you need any clarifications on this answer, please let me know. I'd
be pleased to clarify my question before you rate it.

This is a very old expression that has been modified and re-modified
so many times over the years to suit various purposes that isn't
likley to be traceable to a verifiable origin. I found credits for the
phrase to the likes of Mercedes Lackey and also to an unknown Supreme
Court Justice.

I also found that it has since been recorded a number of ways:

"Your right to _______ ends at my nose"

fill in the blank:

Swing your fist

Swing your arm

Swing your cane

Throw a punch

Smoke 

Protest

Pollute the air

Flail your fists 


etc...

Good Luck
tutuzdad-ga