December, 17 2014, 01:00pm EDT
FCC and Sunlight Foundation Undercounted Pro-Net Neutrality Comments and Should Immediately Correct the Record
WASHINGTON
Several media outlets have run headlines based on a study that the Sunlight Foundation published yesterday that is based on faulty data, which drastically underrepresents the number of pro-net neutrality comments the FCC received during its second comment period.
Based on an initial look at the data by Fight for the Future's technologists, it appears that there are two major issues:
The FCC failed to register a significant number of pro-net neutrality comments that were sent. We've thus far identified at least 150,798 comments that were missing from the FCC's data dump, and ongoing analysis of their data suggests that this number is in fact much higher. This alone is enough to completely unseat the conclusion that anti-net neutrality commenters "dominated" the second comment period.
The Sunlight Foundation's analysis used a flawed data set that misleadingly represented the full set of comments; it ignored almost half of the total of the release of the FCC data (by their own admission), close to 800,000 comments, because of difficulty processing those comments. The data Sunlight used cannot be assumed to be "reasonably representative" of all the comments. There were several methods by which comments could be submitted to the FCC, and because this led to inconsistencies in the FCC's release of the data, it's an error for Sunlight to infer that the excluded comments maintained the same distribution of pro- vs. anti-net neutrality submissions as the data Sunlight did consider. In addition, the Sunlight Foundation also significantly undercounted comments from at least one group, Battle for the Net, by over 100,000 comments. The result is that the Sunlight Foundation's finding that anti-net neutrality groups "dominated" the second round comment period is completely unfounded.
Fight for the Future co-founder Tiffiniy Cheng said, "Millions of people have spoken out in support of net neutrality, and their voices matter. Getting these numbers right is important. The FCC and the Sunlight Foundation need to act immediately to correct the record, and media outlets that have ran stores based on the faulty data should publish prominent corrections."
"Sunlight applied a flawed sampling methodology to a flawed set of data, and drew conclusions that are impossible to make with any 'reasonably representative' certainty," said Jeff Lyon, Fight for the Future's Chief Technical Officer, "Sunlight's approach is like trying to draw conclusions about the average income in Massachusetts by only surveying people in Boston." Lyon provided the following explanation of the serious errors he was able to identify in Sunlight's analysis:
There are two major problems with the data the FCC released and the resulting study:
The Sunlight Foundation based its study on the data released by the FCC in this October 22 blog post by Gigi Sohn. However, the FCC failed to register hundreds of thousands of pro-net neutrality comments from Battle for the Net.
Sunlight's methodology was flawed. Sunlight was unable to parse all of the data released by the FCC. According to the FCC, there were 2.4 million comments in the data, but Sunlight was only able to read 1.6 million comments. Sunlight's study is based on a subset of the data that misses close to half of all the comments in FCC"s data dump; this data set is not reasonably representative of the big picture but in fact was comprised mainly of one set of comments. Furthermore, Sunlight significantly underreported the number of comments from Battle for the Net that the FCC actually recorded.
In actuality, there were at least 998,498 comments sent from Battle for the Net, but between the FCC not recording them and Sunlight applying a flawed methodology to analyze what little data there actually was, the end result was completely distorted.
The FCC failed to register our comments:
In the FCC's release of the data, Ms. Sohn reports that the FCC received 725,169 comments through ECFS and CSV uploads during the second comment period from July 19th to September 15th.
However, just between September 12th and September 15th, Battle for the Net sent 527,953 comments through CSV uploads alone.We also submitted 470,596 more comments via ECFS and email. Battle for the Net's numbers alone are far higher than the numbers reported by Ms. Sohn.
Given that numerous other individuals and organizations were submitting net neutrality comments during the same period, at best the FCC is severely underreporting the number of comments sent out from pro-net neutrality activists.
To verify this, we downloaded and analyzed the data dump of all comments received by the FCC during the second commenting period, and compared our data to the FCC's. Please note that we have thus far only analyzed the 527,953 comments sent via CSV, and we are still processing reports on the data submitted by ECFS and email.
Total number of comments we submitted via CSV: 527,953
Almost all of these submissions used an open letter by Senator Angus King with each participant signing on. To do a sanity test, we checked our CSV data for two of the phrases from the letter:
Number of occurrences of phrase: 'These principles of fairness and openness' in our CSV comments: 525,189 (this number may be lower than actual due to aggressive deduplication)
Number of occurrences of phrase: 'We are writing to urge you to implement' in our CSV comments: 525,189 (this number may be lower than actual due to aggressive deduplication)
Next, we scanned the data from the dump of FCC's ECFS comments from the second commenting period.
Number of occurrences of phrase: 'These principles of fairness and openness' in FCC's data dump of ECFS comments: 374,421
Number of occurrences of phrase: 'We are writing to urge you to implement' in FCC's data dump of ECFS comments: 374,391
We identified 525,189 CSV comments, and found that at most the FCC only recorded 374,421. From this basic analysis alone, it is clear that, at best, the FCC missed a huge number of the comments we submitted via CSV. But we also sent over 470,596 more comments via email and through FCC's ECFS site, (before it broke from all the load we put it under). Initial results are indicating that a large number of these comments submitted through email and ECFS were also not recorded by the FCC, but we are still generating reports to more precisely quantify those numbers.
We are running a more thorough analysis of the data to identify all the individuals whose comments were not recorded by the FCC, but crunching through all of this data will take several hours.
Sunlight's methodology was not "reasonably representative".
Sunlight was unable to parse all of the data released by the FCC. According to the FCC, there were 2.4 million comments in the data, but Sunlight was only able to read 1.6 million comments. They chose to base their conclusions on a subset of the data that may not be representative of the big picture. According to Sunlight's own admission:
Clearly, 1.67 million documents is far short of 2.5 million (the number reported in the commission's blog post). We spent enough time with these files that we're reasonably sure that the FCC's comment counts are incorrect and that our analysis is reasonably representative of what's there, but the fact that it's impossible for us to know for sure is problematic
Sunlight also significantly under-reported the number of comments that came from Battle for the Net commenters, estimating this at 271,608. When we pointed out how easily we identified at least 367,460 of our own comments in the data, they acknowledged their error. However, this margin alone could have been enough to tip their conclusions in favor of net neutrality activists.
Furthermore, the FCC confirmed that people who signed petitions would be counted as individual commenters. Many net-neutrality activist organizations attached their petition signatures as PDFs attached to single ECFS filings. Sunlight was unable to parse these PDFs and chose to simply exclude them from their sample pool, ignoring perhaps hundreds of thousands of pro-net neutrality comments. On the other hand, Sunlight was able to easily read all of American Commitment's comments, further distorting their results in favor of anti-net neutrality commenters.
Sunlight applied a flawed sampling methodology to a flawed set of data, and drew conclusions that are impossible to make with any "reasonably representative" certainty.
Fight for the Future is a group of artists, engineers, activists, and technologists who have been behind the largest online protests in human history, channeling Internet outrage into political power to win public interest victories previously thought to be impossible. We fight for a future where technology liberates -- not oppresses -- us.
(508) 368-3026LATEST NEWS
Montanans Launch Push to Get Abortion Rights on November Ballot
"With 2024 shaping up to be the biggest year ever for abortion on the ballot, it is critical that Montanans can make their voices heard on this issue."
Apr 17, 2024
As abortion continues to dominate this year's state and federal political contests, Montanans Securing Reproductive Rights on Tuesday launched a signature collection drive to get a citizen-initiated state constitutional amendment on the November ballot.
Since the right-wing U.S. Supreme Court reversedRoe v. Wade with Dobbs v. Jackson Women's Health Organization nearly two years ago, Republican state lawmakers have ramped up efforts to further restrict abortion care—and voters, including residents of red states, have responded by protecting reproductive freedom when weighing in on related ballot measures.
With little hope that the divided Congress will restore nationwide abortion rights, ballot initiatives for the 2024 cycle are ongoing in various states, from Arizona and Florida to Montana, where "a yes vote on Ballot Issue #14 will keep the government out of our personal lives," as the Montanans Securing Reproductive Rights website states.
"This is an exciting opportunity to secure our rights for generations to come. Now is the time to ensure power remains in the hands of the people of Montana, so everyone has the freedom to prevent, continue, or end a pregnancy should they choose," the site adds. "Politicians have no business controlling our bodies and our futures."
After a legal battle with Republican state Attorney General Austin Knudsen, the ballot language is:
CI-128 would amend the Montana Constitution to expressly provide a right to make and carry out decisions about one's own pregnancy, including the right to abortion. It would prohibit the government from denying or burdening the right to abortion before fetal viability. It would also prohibit the government from denying or burdening access to an abortion when a treating healthcare professional determines it is medically indicated to protect the pregnant patient's life or health. CI-128 prevents the government from penalizing patients, healthcare providers, or anyone who assists someone in exercising their right to make and carry out voluntary decisions about their pregnancy.
Montana currently allows abortion care up until fetal viability. In response to a legal challenge from Planned Parenthood of Montana (PPMT), a trial judge in February struck down three laws passed by the Republican-controlled state Legislature in 2021: a 20-week ban, restrictions on medication abortions, and a rule that providers must offer patients an ultrasound.
"We are relieved that Montanans will no longer live with the threat of these harmful restrictions taking effect. But make no mistake, our fight continues," PPMT president and CEO Martha Fuller said at the time. "For years anti-abortion politicians at all levels of government have made banning abortion their number one priority, despite the current protection held in our state constitution."
"During the 2023 Montana legislative session, an onslaught of anti-abortion bills was introduced, passed, and signed into law, and PPMT is working hard to beat back these attacks and more," Fuller continued. "We will never stop working to ensure that all Montanans and those who are forced to travel here for care can access the care they need."
In addition to Planned Parenthood, Montanans Securing Reproductive Rights is a campaign by the ACLU of Montana, the Fairness Project, and Forward Montana. The coalition now needs to collect 60,000 signatures by June 21.
"Anti-abortion extremists have tried to interfere in Montanans' personal healthcare choices again and again. That's totally unacceptable—Montanans deserve to make their own decisions about reproductive care, not have politicians decide for them," the Fairness Project executive director Kelly Hall said Tuesday.
"The Fairness Project is proud and excited to be supporting Montanans Securing Reproductive Rights in their campaign to pass CI-128, especially at a time when abortion rights are under attack," Hall added. "With 2024 shaping up to be the biggest year ever for abortion on the ballot, it is critical that Montanans can make their voices heard on this issue."
Keep ReadingShow Less
Spain Widens Push for EU Countries to Recognize Palestinian State
A majority of U.N. member states recognize Palestinian statehood, but the U.S. and most E.U. countries lag behind.
Apr 17, 2024
In his latest stop on a tour of several European countries aimed at gathering support for recognizing a Palestinian state, Spanish Prime Minister Pedro Sánchez joined his Slovenian counterpart on Tuesday in calling to make the diplomatic move to help secure an end to the Israeli-Palestinian conflict.
Palestine is already recognized as a state by the vast majority of United Nations members—139 out of 193 countries—and by a handful of European nations, but the European Union as a whole, the United States, and the United Kingdom are among those that have long refused to recognize statehood.
At a joint press conference with Sánchez, Slovenian Prime Minister Robert Golob said the question is "when, not if, but when is the best moment to recognize Palestine."
Al Jazeera reported Wednesday that Sánchez aims to formally recognize Palestinian statehood by July, even if he does not secure enough support from other E.U. countries.
"The time has come for the international community to once and for all recognize the state of Palestine," Sánchez said in November. "It is something that many E.U. countries believe we have to do jointly, but if this is not the case, Spain will adopt its own decision."
Sánchez has also met with leaders in Ireland, Malta, and Norway in recent weeks.
Jonas Gahr Støre, prime minister of Norway—which is not an E.U. member—said last week that his government "stands ready" to join "like-minded countries" in recognizing Palestinian statehood.
Irish Prime Minister Simon Harris said after meeting with Sánchez last Friday that formal recognition "is coming much closer and we would like to move together in doing so."
"The people of Palestine have long sought the dignity of their own country and sovereignty—a home that like Ireland and Spain can take its place amongst the nations of the Earth," Harris added.
Ireland's Green Party said Monday that the full recognition of Palestine by European countries would help to secure a cease-fire in Gaza, where Israel has killed at least 33,899 people since October and has so far starved more than two dozen children to death by blocking the vast majority of humanitarian aid for months.
Al Jazeerareported Wednesday that Belgium—which has called for economic sanctions on Israel over its bombardment of Gaza—is likely to join Spain's push after June, when the country no longer holds the E.U. presidency.
The push from Spain comes as the U.N. Security Council is scheduled to vote on whether to admit Palestine as a full member of the U.N., which the Spanish prime minister said would be supported by the governments he's met with.
Palestinian representatives announced earlier this month that they would revive their application for membership, which the U.S. has vetoed in previous votes.
"We are seeking admission. That is our natural and legal right," said Riyad Mansour, the Palestinian ambassador to the U.N. Palestine has held observer status in the U.N. since 2012.
The League of Arab States on Tuesday expressed its "unwavering support" of the Palestinians' new application.
"Membership in the United Nations is a crucial step in the right direction towards a just and lasting resolution of the Palestinian question in line with international law and relevant U.N. resolutions," said the group of 22 countries.
U.S. State Department spokesperson Matthew Miller told reporters this month that full U.N. membership for Palestine "should be done through direct negotiations through the parties," while Israeli U.N. ambassador Gilad Erdan said the fact that the application is being considered is "a victory for genocidal terror."
The Arab League urged U.N. members "not to obstruct this critical initiative."
Keep ReadingShow Less
Israeli Settlers, Soldiers 'Wiping Palestinian Communities Off the Map' in the West Bank
"While the attention of the world is focused on Gaza, abuses in the West Bank, fueled by decades of impunity and complacency among Israel's allies, are soaring."
Apr 17, 2024
Israeli soldiers have either passively watched or participated in the uprooting of at least seven communities in the West Bank since October of last year, Human Rights Watch said Wednesday in a new report documenting surging settler violence in the occupied Palestinian territory.
The rights group interviewed dozens of eyewitnesses and examined video footage showing harassment and other abuse of Palestinians in the West Bank "by men in Israeli military uniforms carrying M16 assault rifles."
Following the Hamas-led October 7 attack on southern Israel, the Israeli military drafted more than 5,000 settlers into "regional defense" units in the West Bank, Haaretzreported earlier this year. The Israeli newspaper noted that "alongside this large-scale mobilization, the [Israel Defense Forces] has distributed some 7,000 weapons to the battalions as well as to settlers who were not recruited into the army but received them as civilians whom the army considers eligible to carry military arms."
HRW's investigation found that "armed settlers, with the active participation of army units, repeatedly cut off road access and raided Palestinian communities, detained, assaulted, and tortured residents, chased them out of their homes and off their lands at gunpoint or coerced them to leave with death threats, and blocked them from taking their belongings."
"Israeli settlers and soldiers are literally wiping Palestinian communities off the map," said Omar Shakir, HRW's Israel and Palestine director.
"While the attention of the world is focused on Gaza, abuses in the West Bank, fueled by decades of impunity and complacency among Israel’s allies, are soaring."
The new report comes days after Israeli settlers—escorted by IDF soldiers—went on their latest destructive and deadly rampage in the West Bank, killing at least two Palestinians, injuring dozens, and setting homes and vehicles ablaze. At least 20 households were displaced after Israeli settlers burned down their homes.
The wave of settler violence came after a missing 14-year-old Israeli boy was found dead in the area around the West Bank city of Ramallah. The Israeli military said the boy was killed in a "terrorist attack."
Since October 7, according to the United Nations, Israeli settlers have launched more than 720 attacks on Palestinians in the West Bank, displacing at least 206 households comprised of 1,244 people—including 603 children. Israeli soldiers in uniform have been present at many of the attacks.
"Settlers and soldiers have displaced entire Palestinian communities, destroying every home, with the apparent backing of higher Israeli authorities," Bill Van Esveld, associate children's rights director at HRW, said in a statement Wednesday. "While the attention of the world is focused on Gaza, abuses in the West Bank, fueled by decades of impunity and complacency among Israel's allies, are soaring."
HRW's new report examines five West Bank communities that have come under attack by Israeli settlers, including one in which uniformed Israeli men armed with assault rifles entered tents and destroyed or stole people's belongings, abused residents, and threatened to kill them if they didn't leave the area.
"One man in uniform kicked me in the back of my neck," a Palestinian mother told HRW. "They said, 'Go to the valley, and if you come back, we will kill you.'"
None of the families forcibly evicted from the five communities examined in the HRW report have been allowed to return home.
"Palestinian children have seen their families brutalized, and their homes and schools destroyed, and the Israeli authorities are ultimately to blame," Van Esveld said Wednesday. "Senior state officials are fueling or failing to prevent these attacks, and Israel's allies are not doing enough to stop that."
Following the latest wave of settler violence in the West Bank this past weekend, a coalition of human rights organizations said in a joint statement Wednesday that "the international community must swiftly and decisively pressure the government of Israel to halt these attacks and urgently de-escalate the situation."
"With international attention centered on Gaza, the government of Israel has not only allowed settler violence to spiral but also persisted in the expansion of Israeli settlements built on Palestinian land and unlawfully seized Palestinian territory by designating it as 'state land,' blatantly violating international law," the groups noted. "Concerted efforts are needed to tackle the root cause of settler violence by permanently dismantling settlement outposts and ensuring the safe return of displaced Palestinians to their lands."
Keep ReadingShow Less
Most Popular