NFD
normal UTF form, then remove the entire combining character class. Details.Example: the Facebook Community Payments terms are Terms of Service. The only way to declare them in the Facebook service would be to add a “Community Payments Terms” terms type as they would otherwise conflict with Facebook’s Terms of Service. It is better to declare a new service called “Facebook Payments” with its own Terms of Service. It turns out that this service also has a developer agreement, independent from the main Facebook service.
Example: Apple’s App Store uses only generic terms (“app” and “store”). However, it is of common use to mention “the App Store” as Apple’s. To help us decide whether it should be prefixed or not, we can check that Apple has trademarked “App Store”. The service can thus be named “App Store”, without prefixing.
Noise is unwanted content in versions.
The first type of noise we try to remove is content that is not relevant legally speaking, and that harms terms readability.
CSS selectors are a first step as they permit to select an area instead of the whole page, but they let pass through content such as headers, footers, buttons, drop-down lists…
Filtering permits to get rid of the remaining irrelevant content.
A drop-down list lets users select which terms they would like to see but this list doesn’t interest us in the final version.
HTML file :
<div class="filter-holder">
<select class="filter-options">
<option value="https://www.redditinc.com/policies/user-agreement" selected>User Agreement</option>
<option value="https://www.redditinc.com/policies/privacy-policy">Privacy Policy</option>
<option value="https://www.redditinc.com/policies/content-policy">Content Policy</option>
<option value="https://www.redditinc.com/policies/broadcasting-content-policy">Broadcasting Content Policy</option>
</select>
</div>
<h1>Reddit User Agreement</h1>
Markdown file :
User Agreement Privacy Policy Content Policy Broadcasting Content Policy Moderator Guidelines Transparency Report 2017 Transparency Report 2018 Guidelines for Law Enforcement Transparency Report 2019
Reddit User Agreement
=====================
Wished Markdown file :
Reddit User Agreement
=====================
Target elements in the remove
property of a declaration.
The second type of noise we try to remove are elements invisible in the original HTML page that become visible in Markdown or that disrupt Markdown rendering.
An invisible paragraph (with display:none style) visible in the Markdown.
HTML file :
<h1>Twitter Terms of Service</h1>
<p style="display: none;">goglobalwithtwitterbanner</p>
Markdown file :
Twitter Terms of Service
========================
goglobalwithtwitterbanner
Wished Markdown file :
Twitter Terms of Service
========================
Invisible elements that disrupt Markdown rendering usually do so by being taken into account by HTML to Markdown conversion, whereas they were not in the original page.
Invisible links disrupts numbering.
HTML file :
<h2>AGREEMENT</h2>
<ol>
<a id="1"></a>
<li>
<span>Eligibility</span>
</li>
<div class="divider"></div>
<a id="2"></a>
<li>
<span>Term, Terms and Termination</span>
<li>
</ol>
Markdown file :
AGREEMENT
---------
2. Eligibility
5. Term, Terms and Termination
Wished Markdown file :
AGREEMENT
---------
1. Eligibility
2. Term, Terms and Termination
Target elements in the remove
property of a declaration.
The third type of noise we try to remove is content whose changes are both too frequent and legally irrelevant.
We found that those contents are usually hypertext links, since two links can point to the same website yet they can be written differently. A case in point are links passing parameters : a change in parameters will not change where the link point at.
A link has a parameter ‘h=’ changing too frequently and irrelevant to the adress the link point to.
HTML file :
You can only use our copyrights or <a href="https://l.facebook.com/l.php?u=https%3A%2F%2Fen.facebookbrand.com%2Ftrademarks%2F&h=AT0_izDHO3yJuXJuJJeWQyJFVilQqIDOA3oMwr51t6gEq1q4UbyH2VtU7UhNzhg1LH0YzUHAjw0TADuoufWgb_YEuzoFpvyIR8_4rkUfjDXxUw3q1KmpsYL_H3C4OIm3xHzrUZRatmWQ6PAk">trademarks (or any similar marks)</a>
Markdown file :
You can only use our copyrights or [trademarks (or any similar marks)](https://l.facebook.com/l.php?u=https%3A%2F%2Fen.facebookbrand.com%2Ftrademarks%2F&h=AT1XEFWtw25SbFSSD7W2MOS1LQIsUwaUrq4qh5dNmI21qm42JE5lUiv9g8MsTSnvi3DjYfJxOPoBxEKyBQjo7qkxfcUkDzedQzBLWgGJYWC6CwDBI0S5pefB4oiuh8Jo63phreoUKQ3BF4O5)
Wished Markdown file :
You can only use our copyrights or [trademarks (or any similar marks)](https://l.facebook.com/l.php?u=https%3A%2F%2Fen.facebookbrand.com%2Ftrademarks%2F)
Write a filter in the declaration.