²Ô¾®¿Õ·¬ºÅѸÀ×Á´½Ó

    1. <form id=VHjPPVrdo><nobr id=VHjPPVrdo></nobr></form>
      <address id=VHjPPVrdo><nobr id=VHjPPVrdo><nobr id=VHjPPVrdo></nobr></nobr></address>

      *** Voting for the MeFiCoFo Board has begun! ***
      10/5 MeFiCoFo Board Update | Sept. General Site Update

      The Dreams Of Big Data
      March 21, 2013 8:12 AM   Subscribe

      Does Big Data Mean The Demise Of The Expert - And Intuition? - "Data-driven decisions are poised to augment or overrule human judgment." What Is Big Data?

      Are Smart Gadgets Making Us Dumb?
      First, thanks to the proliferation of cheap, powerful sensors, the most commonplace objects can finally understand what we do with them¡ªfrom umbrellas that know it's going to rain to shoes that know they're wearing out¡ªand alert us to potential problems and programmed priorities. These objects are no longer just dumb, passive matter. With some help from crowdsourcing or artificial intelligence, they can be taught to distinguish between responsible and irresponsible behavior (between recycling and throwing stuff away, for example) and then punish or reward us accordingly¡ªin real time.
      A Stunning Vision Of Our Interoperable Future
      At the heart of "Trillions" is the power of the microprocessor. To date, it's been mostly put at the service of personal computing, using individualized tools that only interact with each other when we tell them to. For the authors, we've gone about as far as we can go in this direction - and that's why we've been so frustrated of late with the seemingly unmanageable firehose of data coming out of the global economy. If, as the authors put it, we want to tame the complexity of our world, we need to walk back down the mountain of personal computing and begin climbing Trillions Mountain, which is based on pervasive computing.
      When Public Data Is Too Public
      Everything We Know About What Data Brokers Know About You
      Federal law protects the confidentiality of your medical records and your conversations with your doctor. There are also strict rules regarding the sale of information used to determine your credit-worthiness, or your eligibility for employment, insurance, and housing. For instance, consumers have the right to view and correct their own credit reports, and potential employers have to ask for your consent before they buy a credit report about you.

      Other than certain kinds of protected data¡ªincluding medical records and data used for credit reports¡ªconsumers have no legal right to control or even monitor how information about them is bought and sold. As the FTC notes, ¡°There are no current laws requiring data brokers to maintain the privacy of consumer data unless they use that data for credit, employment, insurance, housing, or other similar purposes.¡±
      The Information: A History, A Theory, A Flood
      In The Information, Gleick neatly captures today¡¯s reality. ¡°We know about streaming information, parsing it, sorting it, matching it, and filtering it. Our furniture includes iPods and plasma screens, our skills include texting and Googling, we are endowed, we are expert, so we see information in the foreground,¡± he writes. ¡°But it has always been there.¡±
      CIA's CTO Gus Hunt: "We try to collect everything and hang on to it forever."

      Big Data Is Neutral: A Tool For Both Good And Evil
      David Brooks concludes in "What Data Can't Do": "This is not to argue that big data isn¡¯t a great tool. It¡¯s just that, like any tool, it¡¯s good at some things and not at others. As the Yale professor Edward Tufte has said, ¡°The world is much more interesting than any one discipline.¡± "

      reinventing Society In The Wake Of Big Data
      What those breadcrumbs tell is the story of your life. It tells what you've chosen to do. That's very different than what you put on Facebook. What you put on Facebook is what you would like to tell people, edited according to the standards of the day. Who you actually are is determined by where you spend time, and which things you buy. Big data is increasingly about real behavior, and by analyzing this sort of data, scientists can tell an enormous amount about you. They can tell whether you are the sort of person who will pay back loans. They can tell you if you're likely to get diabetes.

      They can do this because the sort of person you are is largely determined by your social context, so if I can see some of your behaviors, I can infer the rest, just by comparing you to the people in your crowd. You can tell all sorts of things about a person, even though it's not explicitly in the data, because people are so enmeshed in the surrounding social fabric that it determines the sorts of things that they think are normal, and what behaviors they will learn from each other.
      "Big Data" is not without its critics.

      Evgeny Morzov: The Curse Of 'You May Also Like'
      But when it comes to discovery of new talent and the subsequent production of their work, things look much gloomier. After all, recommendation matters only if there's great art to recommend. If that art is selected based on how likely it is to match the success of previous selections and if it's produced based on immediate feedback from the audience, sales might increase, but will anything truly radical emerge out of all this salesmanship?
      Toward A Complex, Realistic, and Moral Tech Criticism
      Morozov's second book, To Save Everything, Click Here: The Folly of Technological Solutionism, is the most wide-ranging and generative critique of digital technology I've ever read. There's so much substance to argue about between its covers. At the center of it all, there's a brilliant, idiosyncratic mind at work.

      Describing and destroying two concepts -- "Internet-centrism" and "solutionism" -- form the core of his book, and both are fascinating frames for the discourse surrounding our network technologies.
      A review of Evgeny Morozov¡¯s ¡°To Save Everything, Click Here¡±
      From here it is just one more short step to the buy­ing and sell­ing of our per­sonal data: to insur­ers in return for lower pre­mi­ums, to adver­tis­ers in return for bet­ter deals. Our per­sonal data becomes a new ¡°asset class¡± and exec­u­tives respond by ¡°try­ing to shift the focus [of debate] from purely pri­vacy to what we call prop­erty rights¡± (235). New social pres­sures emerge as the dig­i­tiz­ers fol­low their path of bits, algo­rithms and mar­kets (career coun­sel­lors now rou­tinely rec­om­mend that build­ing a strong pres­ence on LinkedIn is a route to a bet­ter job), and we can replace debates about pri­vacy with reas­sur­ances about per­sonal choice. ¡°Pri­vacy is mostly an illu­sion, but you¡¯ll have as much of it as you want to pay for¡± says Kevin Kelly (236). New com­pa­nies emerge to opti­mize our self-presentation on the web (reputation.com), new norms emerge as ¡°If you¡¯re going out with some­one, and they don¡¯t have a Face­book pro­file, you should be sus­pi­cious¡± (Slate¡¯s Farhad Man­joo, quoted on p. 239). Why would you not share your real-time blood alco­hol lev­els with your employer if you don¡¯t have any­thing to hide? (240).
      Douglas Rushkoff: Unlike - Why I'm Leaving Facebook
      I can no longer justify this arrangement. Today I am surrendering my Facebook account, because my participation on the site is simply too inconsistent with the values I espouse in my work. In my upcoming book Present Shock, I chronicle some of what happens when we can no longer manage our many online presences. I argue - as I always have - for engaging with technology as conscious human beings, and dispensing with technologies that take that agency away.
      Adaptation from Present Shock:
      Instead of our offloading time-intensive tasks to our machines, we attempt to match the speed of our network connections. Thanks to the Internet, we travel more on business not less, we work at all hours on demand, and spend our free time answering email or tending to our social networks. Staring into screens, we are less attuned to light of day and the physiological rhythms of our housemates and co-workers. We are more likely to accept the digital clock's illusion that all time is equivalent and interchangeable. But it isn't.
      NY Times review of Present Shock: Out of Time: The Sins of Immediacy
      Among the intuitive ideas turned tangible by ¡°Present Shock¡± is ¡°filter failure,¡± the writer and teacher Clay Shirky¡¯s improved term for what used to be called ¡°information overload.¡± Mr. Rushkoff¡¯s translation: ¡°Whatever is vibrating on the iPhone just isn¡¯t as valuable as the eye contact you are making right now.¡±
      Nassim Taleb: Beware The Big Errors of 'Big Data' and referenced here: Spurious Correlations Everywhere: The Tragedy Of Big Data

      Bruce Schneier (via): Government, Big Data Pose Bigger 'Net Threat Than Criminals
      Schneier said the threat is often obfuscated by the tremendous technical advances the big data players have offered. Google mail is a safer alternative for average users because there's almost no chance they'll ever lose a message. Apple's iPhone is wildly popular because it's easy to use and to date has proved largely impervious to real-world malware attacks. But behind the security and reliability, there are threats many don't consider.

      "I can't find a program that will erase the data on this thing to a reasonable assurance without jailbreaking it," he said, holding up his iPhone. "For me that's bad."
      see also: Battle Of The Internet Giants

      Michael Lind: Stop Pretending Cyberspace Exists - "Treating The Internet As A Mythical Country Makes Us Dumber"
      It is not a parallel universe, coexisting with our world but in a different dimension. It is just a bad metaphor that has outlived its usefulness. Using the imagery of a fictitious country makes it harder to have rational arguments about government regulation or commercial exploitation of modern information and communications technologies.
      Some via. Previously
      posted by the man of twists and turns (73 comments total) 146 users marked this as a favorite
       
      We should A/B test this.
      posted by Artw at 8:17 AM on March 21, 2013 [15 favorites]


      I'm going to analyze the sentiments expressed here towards the big data brand before I comment.

      OOPS!
      posted by Mister_A at 8:26 AM on March 21, 2013


      Big Data, BTW, is the same technocratic pipe dream as universal surveillance. It's only as good as the available analysis and the application of findings to the real world, which are processes that are still governed by us humans.

      And remember, we are the ones asking the questions. Asking the questions defines the range of possible answers. "Big data" will be a slightly embarrassing term in the future when we realize it's really still just 'data'.
      posted by Mister_A at 8:30 AM on March 21, 2013 [12 favorites]


      Terrific post though Twisty! May I call you Twisty?
      posted by Mister_A at 8:31 AM on March 21, 2013


      A bunch of people are going to make a bunch of stupid decisions based on stupid big data and are going to lose a lot of money for it.
      posted by effugas at 8:31 AM on March 21, 2013 [1 favorite]


      A bunch of people are going to make a bunch of stupid decisions based on stupid big data and are going to lose a lot of money for it.

      and/or lives.
      posted by Thorzdad at 8:36 AM on March 21, 2013 [4 favorites]


      A bunch of people are going to make a bunch of stupid decisions based on stupid big data and are going to lose a lot of money for it.

      Indeed. While it's true that your analysts are only as good as their data, it is equally true that your ability to make good data-driven decisions is only as good as your analysts.

      (viz. Nate Silver vs. the GOP establishment, who all had access to the same polling dataset leading up to November 2012, and reached, umm, different conclusions)
      posted by dersins at 8:37 AM on March 21, 2013 [9 favorites]


      Terrific post though Twisty! May I call you Twisty?

      No, that is someone else.
      posted by the man of twists and turns at 8:39 AM on March 21, 2013 [2 favorites]


      This post has introduced me to Farnam Street, for which I sincerely thank you.
      posted by jbickers at 8:39 AM on March 21, 2013 [3 favorites]


      Well again, it comes down to asking the right questions. Beane was successful with the A's because he asked the right questions. Or rather, questions that had measurable answers and that seemed to have some correlation with on-field success. You see, Beane was not "just a number cruncher," he was a very bright man, an expert in his field, and a highly creative thinker.

      As time wears on, we see other people asking other questions, with varying degrees of success. Do the Mets have analysts? Of course! But they (the team) still suck. There's a lot more to it than access to data. You need access to brilliance to really shine the way Beane's A's teams did.

      So yes, a lot of people will use data to make decisions without considering the implications fully, and without understanding the limits of the data. I think the second part there is the biggest issue. People have a limited understanding of the value of data, how to tell if it's clean, when to discard as outdated or outliers, etc. We have, as a society, even less of a grasp on the ways in which data can be manipulated into supporting almost and position.

      So same as it ever was, really.
      posted by Mister_A at 8:43 AM on March 21, 2013 [3 favorites]


      "Big data" will be a slightly embarrassing term in the future when we realize it's really still just 'data'.

      Even then, it's just "data" in the sense of ones and zeroes. Just because it's information doesn't mean it's informative, y'know?
      posted by Sys Rq at 8:48 AM on March 21, 2013


      I am a bit of a Big Data nerd -- not so much using and implementing it, but looking at what it allows us to do and what the implications may be -- so this is an awesome post. I likely won't have time to read it until much later today, but thank you for compiling these links!
      posted by asnider at 8:48 AM on March 21, 2013


      Big data" will be a slightly embarrassing term in the future when we realize it's really still just 'data'.

      Yes ... but it will also give us a term to rally around for a while while we discuss these big issues at cocktail parties, around various water coolers.

      A bunch of people are going to make a bunch of stupid decisions based on stupid big data and are going to lose a lot of money for it.

      and/or lives.


      To which I would counter, but how many better informed decisions will be made based on greater accumulations of available information. How many lives will be saved? Which will forever be the issue with progress/innovation -- being humans, it tends to bring out both the good and the bad in us.

      Or as Mister_A pointed out:

      Well again, it comes down to asking the right questions.

      I mean, hate the airplane all you want, it's done magnitudes to bring together people from all over the world who would otherwise never have met ... and the steam engine before it.
      posted by philip-random at 8:56 AM on March 21, 2013


      If the only concrete example of an actual instance of successful use of 'big data' the author can come up with is picking a baseball team then I find it very hard to believe that these big data decisions are going to have an impact in many other fields.

      The article presumes that for most decisions there is some possible data set out there that could somehow inform my choice in the matter. I just don't believe that is true of many things.
      posted by mary8nne at 8:58 AM on March 21, 2013


      Data ¡ª so much that 90% of the data in the world today has been created in the last two years alone

      Isn't it a little suspicious? Like aren't there useful pieces of information from before 2011?
      posted by Reasonably Everything Happens at 9:04 AM on March 21, 2013 [1 favorite]


      You know when it's Thanksgiving, and you've got this plate full of really awesome food and have no idea where to start because it all looks so good? Great post - as a data guy myself I really enjoy reading the opinions of others in related fields.
      posted by antonymous at 9:07 AM on March 21, 2013


      I find it very hard to believe that these big data decisions are going to have an impact in many other fields.

      It's huge in politics (election campaigns, primarily, but also in the partisan hackery that goes on between elections). Big Data makes it a lot easier to target individual households that may represent swing voters who just need that extra push, particularly among demographics who parties would traditionally ignore as not being the type who vote for them.

      So...to pick a made-up example: the Yellow Party normally does terrible among African-American women. But women who shop at Target, prefer beer over wine, and have a household income of greater than $60,000 are very likely to vote for the Yellow Party, regardless of their race. Suddenly, instead of not bothering to send someone to go door-knocking in African-American neighbourhoods, you can send someone to go knock on 5 - 10 very specific doors in an African-American neighbourhood and pick up those extra votes that you'd have overlooked in the past.

      That may be a really cynical way of running an election campaign but, based on what I've been hearing (mostly anecdotally) for the past few years, it works.
      posted by asnider at 9:15 AM on March 21, 2013 [1 favorite]


      Isn't it a little suspicious? Like aren't there useful pieces of information from before 2011?

      Without knowing the context (as in, which article you're referring to), I'd say it's definitely plausible. To take an example from surveillance tech, there is a technology called ShotSpotter, which helps pinpoint the location of gunfire. This means that in areas of the city where this technology is deployed, there are microphones which are constantly listening to everything, and the technology that this company deploys does an analysis of every sound and alerts the police only when gunfire is detected. Think of all the times that there is NOT gunfire during the day, and you start to imagine the scope of data that is being processed by this technology. While this particular tech has been around for several years, it's a good example of the massive quantity of data (such as sound) that has become easier to analyze in recent years. Now apply facial recognition and gait-detection to the video cameras that have become ubiquitous in recent years, and the data points just multiply...
      posted by antonymous at 9:15 AM on March 21, 2013 [2 favorites]


      Isn't it a little suspicious? Like aren't there useful pieces of information from before 2011?

      The keyword there is useful - we're producing data at an incredibly expanding rate at the moment, but not all data is useful data. Data does not equal information; that requires a lot of work and I don't think we as a species are very good at that yet. I'm currently reading Nate Silver's Signal and the Noise, which is a good introduction to the problems we run into when dealing with making predictions, even when we have large data sets behind us.

      I'm on the edge of Big Data, and working with the very large historical databases my organization has created over the years, so this post is very much in my interest zone. Thanks!
      posted by never used baby shoes at 9:15 AM on March 21, 2013 [1 favorite]


      If the only concrete example of an actual instance of successful use of 'big data' the author can come up with is picking a baseball team then I find it very hard to believe that these big data decisions are going to have an impact in many other fields.

      Every decision made by the President's reelection campaign was driven by data, "Big" and small. It's how the campaign knew who to talk to, how to talk to them, and what to say.

      Turnout (and persuasion) target universes were created based on demographics, geography, publicly available information, consumer data, field-collected data, and just about every other kind of information you could imagine. Methods of contact, script--hell, even email subject lines-- were data- (and a/b-testing) driven decisions as well.

      Digital analytics were also a huge part of an incredibly successful effort (as measured by on-line donations) at targeting on-line advertising.

      These data-driven decisions were the effort that made it possible for a very vulnerable President of a country with a slumping (ish) economy to win re-election in what was effectively an electoral college landslide.

      This is also exactly how then-Senator Obama won first the 2008 Democratic nomination, then the Presidency.

      I'd classify that as, um, kind of an impact.
      posted by dersins at 9:19 AM on March 21, 2013 [2 favorites]


      As long as there is data, there will be people to misinterpret it.
      posted by TheWhiteSkull at 9:21 AM on March 21, 2013 [1 favorite]


      The closer to 'ground truth' we are able to sample the better, recognizing that we can rarely get there for any large N.

      Seconding 'big data' is just data and we've previously been small-minded and forced to invent statistics and sampling (and over- and under- sampling) for just about any data source of a useful size. That's not a dig on statistics, any truthful practitioner thereof will own that the human at the front end of it who needs to look at it and ask "does that even kind of look right?" is as much a part of the practice as the model.

      Some forms of interconnected, data-emitting universal computing matter will appear useful, only until someone actually plots the Big Table that contains all the nodes not reporting. So your garbage can determine if your'e recycling? Cool, that's say a few million rows of data in. Now let's go ahead and populate with the guess of total rows we should use if we want to account for all the refuse that's not so enabled.... oh that's a trillion rows. Of almost all nulls. So from that data we can conclude....

      Let's just filter out those pesky null reports because... reasons.

      There we go! People in Pennsylvania hate the environment and nobody recycles on Tuesdays. Rejoice!

      I'm a twelfth-dan data nerd and the first tenet of my personal technical religion is "no magic." Big data presents the same problems as small data with an enormously higher error rate. But, as with most things, when any inference is presented based on data without denominators, some folks will be impressed and find very clever ways to adapt it to the conclusion they were gunning for.

      Further, the A's success wasn't big data, it was good analysis. It was falsifying hypotheses so easily falsifiable the work could have been done pre-computers (and was), then the very hard work of building new testable hypotheses and refining them. The hard part was getting someone to apply basic empiricism in a system full of gut, tradition, and a universe of untracked data on which decisions were based.
      posted by abulafa at 9:23 AM on March 21, 2013 [5 favorites]


      I did my undergrad in Poli Sci and Psych, and work in IT professionally. One of the most important thing I learned in my undergrad was the difference between analog and digital measurement.

      I think more and more about Xeno's Paradox. The more you are counting the segments in movement of an arrow's arc towards its target, there could be a million points where it may seem like its not going to hit. Having more data doesn't mean you can make accurate predictions.

      God that sounds convoluted. I need to brush up on my writing skills. Anyways, thanks for the post. I'll try to read up on what I've missed recently.
      posted by lslelel at 9:25 AM on March 21, 2013 [3 favorites]


      There will be a lot of failures in 'big data'. There already have been. Measuring the wrong thing, false precision, personality winning out over science, trying to use tools and methods that worked great for 100K samples, but fallover at 100M. That happens everywhere, all the time. It's just more noticeable in new and sexy trends that get print ink, and twitter links.
      posted by DigDoug at 9:25 AM on March 21, 2013 [1 favorite]


      As long as there is data, there will be people to misinterpret it.

      This is the key point. We need, to pick a current hero of big data, Nate Silvers to use their knowledge and intuition to guide the results. Garbage in still gets garbage out. Quality/Sanity checking model outputs is really important.

      Stuff like Google Now can be impressive, but automatic inference still gets things wrong more often than not (what happens if I want to stop at the Grocery store instead of just heading home? Traffic info is not so useful for that .)
      posted by bonehead at 9:30 AM on March 21, 2013 [1 favorite]


      dersins: "Indeed. While it's true that your analysts are only as good as their data, it is equally true that your ability to make good data-driven decisions is only as good as your analysts.

      (viz. Nate Silver vs. the GOP establishment, who all had access to the same polling dataset leading up to November 2012, and reached, umm, different conclusions.
      "

      Something else that's occurred to me, as I've begun delving into one of the archaeological equivalents of "big" data, is that there are also two radically different ways to approach massive datasets. You can either ask questions of the data, or you can use the data to create new questions. Just about any koopa can query a dataset for information, but it takes a deeper understanding to synthesize the data into something more than the sum of its parts.

      The GOP are just koopas. Nate Silver, on the other hand, is clearly a magikoopa.
      posted by barnacles at 9:40 AM on March 21, 2013 [4 favorites]


      On the subject of smart gadgets, I thought this looked interesting. A Bluetooth-enabled subdermal sensor that could theoretically warn you a few hours before a heart attack.
      posted by CheeseDigestsAll at 9:51 AM on March 21, 2013 [1 favorite]


      but it takes a deeper understanding to synthesize the data into something more than the sum of its parts

      Yes, exactly! My current way of talking about this during interviews (boo job search) is that you can't just "look at the numbers" to be effective in analyzing data. You have to be able to puzzle out what story the numbers are really trying to tell you, which usually means knowing the right questions to ask-- just like a reporter or an investigator.

      But even that's not enough: you have to be able to tell that story in a way that makes sense to the people making the actual data-driven decisions, who usually aren't the people actually elbows-deep in the dataset.
      posted by dersins at 9:57 AM on March 21, 2013 [5 favorites]


      Wonderful post! I literally just came out of a meeting at our community college about how our math and composition developmental curriculum is being completely and quickly revamped by the state. The faculty have raised numerous concerns where we see our classroom experience conflicting with these new proposals, but we're repeatedly told that the college system is moving to data-driven decision making, and we just have to adapt to this new process.

      I don't doubt that some of our anecdotal evidence is not as universal as we think it may be, but when we can actually use data back at them - the numbers you propose are different than the numbers we actually see - we're being told that we must be an "outlier." We're the 2nd largest community college in the state, but we're an outlier.

      I'm not optimistic.
      posted by bibliowench at 9:57 AM on March 21, 2013


      Scientists (more physicists and chemists than biologists) have been swimming in data for years, and I feel like something could be learned there; but the answer "you need to become a scientist to make use of Big Data" seems suspect :). I'm watching (and participating) as biology becomes increasingly data driven and it's pretty horrifying to watch people assume that "data = answers", although of course there have always been people pointing out that data can actively mislead you as well. The physicists with CERN can combine theory with data analysis to produce results, which seems like the best way -- I'm sorry but I can't find a good link that explains how they do it, although I've heard multiple talks about it!
      posted by ctitusbrown at 10:00 AM on March 21, 2013 [1 favorite]


      The other day an internet pal of mine tipped me off to this "surveillance symposium" on youtube with Jacob Appelbaum, Bill Binney,and Laura Poitras. Claim is the NSA is collecting all our e-mails, phone logs, facebook friends, &c. and they claim it is legally not surveillance to store it without inspecting it. They don't need a court order unless they decide they want to read it, at which time they think they have enough data to read your mind. What they are collecting, just in case, is every datum you have ever created by existing.
      posted by bukvich at 10:00 AM on March 21, 2013 [2 favorites]


      The faculty have raised numerous concerns where we see our classroom experience conflicting with these new proposals, but we're repeatedly told that the college system is moving to data-driven decision making, and we just have to adapt to this new process.

      Oh great, Six Sigma for education... because we totally need to treat everything like a fucking assembly line.
      posted by DigDoug at 10:05 AM on March 21, 2013 [1 favorite]


      So much data flowing out, sitting around, yet only a fraction of that can probably be made useful.

      Much like there is so much methane flowing out into the atmosphere, yet only a fraction of that too can probably be made useful.

      And with both: the implications of making them useful are both OK and frightening.

      Yet I must get back to work making pages that display various data sets in the most user friendly way possible.

      Interesting times, to say the least.
      posted by JoeXIII007 at 10:07 AM on March 21, 2013


      more physicists and chemists than biologists

      Wildlife/population ecology, bioinformatics, to name a couple.

      Geologists too: GIS systems are nothing if not Big Data.

      Dealing with Big Data has been one of, if not the, largest change and challenge for the current generation of scientists.
      posted by bonehead at 10:13 AM on March 21, 2013


      Oh my! There are so many things I'd like to say on this post, but will try to pick a few relevant to the comments; I may not be a 12th-dan data nerd but I've "stolen a few horses" in the data world.

      ...the first tenet of my personal technical religion is "no magic."

      I'll second that and turn it back on analytic techniques: There is no such thing as a "magic wand." I am a 12th-dan genetic programmer, but I will be the first to tell you it's not a magic wand. Same with every other analytic technique (yes, even Bayesian statistics Nate.) There is a theorem in analytics called the NFL Theorem where 'NFL' stands for No Free Lunch. It roughly states: There is no algorithm that will work any better than any other algorithm across all data sets. IE, there is no magic wand.

      One of the things I do is what I call "listening to data." By that I mean one should take the attitude that the data is trying to tell you something based on the results of your analysis, but it's not necessarily the answer to the question you asked. Here is an example: For the last 12 years, I have been working in bioinformatics and in particular in analyzing molecular data. I began a long collaboration with a lab at USC studying bladder cancer. They had a set of particularly reliable data and the lead researcher, Dr. Richard Cote, asked me to analyze the data to see if the physical staging of the cancer (T-staging)could be correlated with molecular characteristics, in this case gene expression levels.

      The result of our analysis was messy with poor performance, complex models and a general feeling that we had overfit the data (a common problem with Big Data, but particularly biological data). I decided to look at the samples we were misclassifying and discovered that most of them had the characteristic of having local metastases. So I asked a different question: Is there a genomic signature that identifies tumor samples that have metastsized to local lymph nodes? (Note that this is not analyzing nodal tissue, but the original tumor.) The answer was a swift and unequivocal yes. We eventually found a simple 3 gene model that was very accurate at identifying tumors that had metastasized and, as a bonus, 2 of the 3 genes were associated with metastasis in the literature. Extra bonus: the 3rd gene, while well associated with cancer, was not associated with either metastases or with playing a role in the tumors themselves.

      Anyway, to make a short story long, this result came entirely from "listening" to what the data was trying to tell us, not to the question we were asking. As a side note, it was also telling us that T-staging has nothing to do with molecular characteristics and that the latter are probably better than T-staging (and probably TNM staging) in assessing the danger of the cancer. Disclaimer: The literature has many examples where researchers have probably overfit the data in drawing a conclusion. Always check for validation, particularly prospective validation.

      Anyone interested in reading about this study, it may be found here though it does not talk about how we got to studying from T-staging, only the study of local mets. (Please don't taze me mods!)
      posted by BillW at 10:13 AM on March 21, 2013 [17 favorites]


      Big Data: when hipsters discovered spreadsheets.
      posted by Damienmce at 10:22 AM on March 21, 2013 [5 favorites]


      So, I do "Big Data" work in cheminformatics, and while I understand the skepticism in this thread in the context of using data mining to predict when your socks are going to get holes in them or whatever, there really are spaces (like the space of all possible chemical compounds) that are too large for anyone to become an expert at maneuvering their way through them to the interesting bits. The type of analysis we do on predicting compound activity, for example, just beats the pants off of analyses that use more of a first-principles approach, like docking, or SAR -- we've made a lot of screeners very happy. The key to our success, though, is that we're dealing with a relatively low dimensionality, and figuring out which dimensions are relevant, and how to represent them, is where the expert knowledge comes in.
      posted by invitapriore at 10:23 AM on March 21, 2013 [3 favorites]



      On the subject of smart gadgets, I thought this looked interesting. A Bluetooth-enabled subdermal sensor that could theoretically warn you a few hours before a heart attack.


      Hopefully, not enough false positives to give you a heart attack.
      posted by KaizenSoze at 10:32 AM on March 21, 2013


      If you're not asking the right questions of your data, it doesn't matter how much of it you have.

      (Asking the right questions is rly rly rly hard.)
      posted by PMdixon at 10:39 AM on March 21, 2013 [6 favorites]


      That may be a really cynical way of running an election campaign but, based on what I've been hearing (mostly anecdotally) for the past few years, it works.

      Which is amazing considering how stupid the polling can be.

      About an hour ago I took a telephone call that was an automated poll. The first question was "How likely are you to vote in the upcoming Republican primary for the special election?" and the only options were "Very Likely", "Moderately Likely", "Somewhat Likely", and "Not Likely". After answering "Not Likely" the poll ended.

      I've been trying to figure out what data they're going to take from that. Obviously they bothered calling, so they had some preexisting reason to suspect that I might vote Republican, but does "Not Likely" mean that I'm not voting in the primary because I think Republicans are greedy, sociopathic weasels, or does "Not Likely" mean I'm not excited about the candidates and might change my mind after I receive some campaign calls? They could have included the option "Not Voting Republican" or asked a follow-up question to discern why I'm not a likely voter, but they didn't bother. Though given my political leanings, I can't say I'm upset by this.

      Likewise, when I was polled last fall about the assisted suicide ballot measure, the entire poll was yes/no answers with no room to capture even the slightest bit of nuance. Either someone being incredibly stupid and narrow minded when designing it, or they just wanted to force a certain kind of result. Either way should have resulted in terrible information.
      posted by RonButNotStupid at 10:46 AM on March 21, 2013


      RonButNotStupid, they don't care why you are not likely. They are trying to optimize who they should spend time/money on and someone who self-selects out, for whatever reasons, is not worth spending resources on.

      That said, there are usually a couple of stages in this process depending on where you are in the election cycle and/or how much money the caller has. In an earlier stage, someone might engage you to try to find out why you don't want to vote and whether your are persuadable to vote for their candidate. If they become convinced you are not going to vote for their candidate, they will mark you down as such. Later on, if someone talked to you and you convinced them you were not going to vote for their candidate, even if you were going to vote, they may try to actively convince you of the intrinsic awfulness of your choice (negative campaigning) in order to suppress your vote. Still later, in the final weeks, they are working too hard on getting out the vote (GOTV) and at this point all they are trying to do is get the voters who said they were going to vote for their candidate out to the polls.

      Whether this is the right algorithm or not is an interesting question, but it is how it is done currently.
      posted by BillW at 10:57 AM on March 21, 2013


      Invitapriore: I always hear about the absolute necessity of using people's expertise to find good low-dimensionality representations of the data, but at the same time the forefront of research is definitely heading towards unsupervised learning of these representations.
      posted by curuinor at 11:16 AM on March 21, 2013


      I've been trying to figure out what data they're going to take from that. Obviously they bothered calling, so they had some preexisting reason to suspect that I might vote Republican, but does "Not Likely" mean that I'm not voting in the primary because I think Republicans are greedy, sociopathic weasels, or does "Not Likely" mean I'm not excited about the candidates and might change my mind after I receive some campaign calls? They could have included the option "Not Voting Republican" or asked a follow-up question to discern why I'm not a likely voter, but they didn't bother.

      If they are polling to see which candidate is ahead (like the polls you see in the media), and it sounds like that's what the poll was (PPP maybe?), they do not give a flying fuck why you are not voting. Assuming the poll is one of "likely voters" (as most are), once you self-identify as not a "likely voter", you are dead to them. Completely useless.


      Likewise, when I was polled last fall about the assisted suicide ballot measure, the entire poll was yes/no answers with no room to capture even the slightest bit of nuance.


      Yes/no answers (or multiple-choice with limited options) are pretty much necessary for fast, useful large-scale analysis. Aggregate enough yes/no responses, and you can have an incredibly accurate picture, much more accurate than you can get by reading through unquantifiable "nuance".

      "Some" is not a number, "soon" is not a time, and anecdote is not data.
      posted by dersins at 11:20 AM on March 21, 2013 [2 favorites]


      It's going to really fun when people start poisoning the data to mess with the competition.
      posted by KaizenSoze at 11:20 AM on March 21, 2013 [1 favorite]


      These links cover so many different topics, but there seems to be a common theme among most of them: We are losing control (and suffering consequences) over the mess we created and should stop, drop and PANIC! Or at least take some action against these NEW and possibly EVIL forces. (In more grounded terms, the idea is that technological determinism is king and we need to do something about it.)

      I took a close read of the last link (Stop Treating Cyberspace as if it Exists) earlier this week. It's so full of dumb I can't even.
      "The idea that corporations are ¡°invading¡± a mythical Oz-like kingdom called cyberspace is just as dopey."
      He's talking about the stupidity of the "corporations are people" metaphor, right?
      "If you¡¯re not convinced by now that the very notion of cyberspace is silly, try substituting ¡°fax¡± or ¡°telephone¡± or ¡°telegraph¡± for ¡°cyber¡± in words and sentences. The results will be comical."
      Comical because those are nouns and "cyber" is an adjective?
      "Again, the point is not that telecommunications should not be structured and governed in the public interest, but rather that the debate about the public interest is not well served by the Land of Oz metaphor."
      I think we all can agree that "Land of Oz" is a stupid metaphor. Since it's only come into being as of this article, let's let it live out the rest of its days there as well.
      "My guess is that cyber-hype is on the way out, for several reasons. For one thing, the novelty of PCs and wireless phones has worn off. They are no longer mystical portals to another dimension, but mere appliances."
      In other news, fortune-telling is also pass¨¦. Crystal balls no longer telling futures, but can be used as lovely decorations. Also, Mac Cubes make great fishtanks.
      "While we can all get smarter merely by dropping the term ¡°cyberspace,¡± it¡¯s not necessary to get rid of cyberspace itself. There never was any such thing."
      This article never existed either. Click your scrollwheels at least three times to promptly return Home page.
      posted by iamkimiam at 11:28 AM on March 21, 2013 [2 favorites]


      so anyway, Motron (old friend) was right twenty or so years ago (while high on LSD). Figuring out information is like figuring out the weather. It's that big, it's that complex, it's that important in terms of our day to day lives. You can't predict it but you can forecast it ...

      And I've certainly noticed that the accuracy of our weather forecasts have improved over the years. But they're never perfect. Which makes our increasing reliance on the forecasting problematic. Because it is so often correct, it really is cloudy for a while in the early morning, then sunny until mid afternoon when a few clouds start rolling in and rain by evening, snow at higher elevations.

      But what happens when there's a powerful blow of wind, a sudden thunderstorm that no data crunching saw coming. These are the moments that remind us what we're dealing with. Chaotic systems that work on probabilities as opposed to possibilities. Which is fine as long as you act based on the former but always be prepared for the latter.
      posted by philip-random at 11:29 AM on March 21, 2013 [1 favorite]


      I was shooting from the hip a little bit there, sorry. This is a good post, with a lot of good links. I don't mean to pick one glaring flaw and blow it out of proportion (as tempting as it is to do...and clearly I have no self-control to resist such urges).

      I'm a huge fan of big data. I'm also a huge fan of mixed methods. I think mixed methods are especially important when dealing with huge amounts of quantitative data (as big data is such). You need a qualitative counterbalance to give all of this some context. And as many have suggested above, to ask the right questions, listen to the data, ask new questions, listen to the data again...and on and on. That process is fun.

      Anyways, lately I've been super interested in the technological determinism arguments. Which is underlying wild ideas about the things that gadgets are doing to our brains, how social networks are ruining our relationships, what spaces and places are real and not real and how stupid we are for thinking such magical thoughts...and on and on. That is also fun to explore. But tiresome at times too.

      In sum, these sorts of things make me both happy and trigger-happy.
      posted by iamkimiam at 11:43 AM on March 21, 2013


      In 2002 the Oakland A's had two things going for them that people always seem to forget when pointing to Beane's data analysis success - their draft successes. The four biggest cogs in the 2002 A's team were an amateur international free agent turned PED using MVP winner (Tejada) and the trio of Zito, Mulder, and Hudson; all four were drafted by the A's and scouted extensively. Sure, Beane's an incredible intellect that asked the right questions and was able to leverage an inefficiency in MLB front offices to score runs but scouting found them the heart of their talent.

      Big data has a lot of potential but ultimately it comes down to understanding what the sandbox is you're playing in before you start drawing inference from the data. It also takes a lot of luck.
      posted by playertobenamedlater at 11:52 AM on March 21, 2013 [1 favorite]


      How Can Big Data have a Social Impact?
      posted by never used baby shoes at 11:56 AM on March 21, 2013


      Having made it through about 2/3 of the links, I can be reasonably certain that this post was the culmination of a deep-seated marketing effort by Amazon to fill my shopping cart with over $100 worth of books.

      One thing that's been on my mind recently is how this data enables us to tell stories that weren't able to be told in the past, or stories that were refuted by conventional thinking. I'm a huge basketball fan, and advanced statistics have changed the way that I analyze and think about the game. Instead of raw numbers (player X grabbed 10 rebounds per game this year), I can discuss stats like rebounding percentage (that is to say, the percentage of available rebounds a player collects), which is a different (and in many respects, superior) assessment of a given player's rebounding ability.

      In a similar vein, I can assess a player like Bruce Bowen, who does not fare well in "conventional" advanced statistics (because he is on the court primarily for defense), and rather than judge him based on how many points he scores or steals he makes, I can now see how much he reduces a given opponent's shooting percentage, and how that in turn creates a "win" for Bowen's team. In the past, comparing the value of a defensive ace and that of a scorer would have been comparing apples and oranges, but it really helps advance the understanding of the game for fans who crave a deeper level of analysis.

      (I know sports is a trite example, but I've found it a fairly compelling topic among my friends who would rather not discuss how data mining is leading to a corporate-run dystopia)
      posted by antonymous at 12:25 PM on March 21, 2013


      Which is amazing considering how stupid the polling can be.

      It's not necessarily about polling, though. At least, not exclusively. They're pulling data sets from all over the place: demographics, consumer data, spending habits, past voting patterns, etc.

      Phone polls play a part in that, but they're increasingly becoming a less important part because no one has a home phone and most phone-bank lists don't have many cell phones included (since you can't just pull them out of the phone book).

      This is one of the many reasons why the pollsters were so very wrong in their predictions in a few recent elections here in Canada. They're using methods that no longer give them accurate data. Sure...maybe everyone with a home phone is going to vote the way their polls predicted, but they missed the increasingly large number of households that don't have a home phone (like mine, for example). This is especially true in Alberta (where the polls were almost comically inaccurate), because we've got so many transient workers and recent arrivals who never bothered to get a home phone installed when they moved here.
      posted by asnider at 12:35 PM on March 21, 2013


      If the only concrete example of an actual instance of successful use of 'big data' the author can come up with is picking a baseball team then I find it very hard to believe that these big data decisions are going to have an impact in many other fields.

      I worked in the grocery industry for a long time, and retail supply chain management definitely qualifies as a "big data" industry at this point. Looking at cost, pricing, and sales trends down to the individual store level, and sussing out associative patterns between user demographics, product types, and so on are all big business at this point. It's not quite as sexy, and I'm a bit conflicted because it's also about replacing humans with algorithms, but there you have it.
      posted by verb at 12:38 PM on March 21, 2013 [1 favorite]


      See also The Philosophy of Data.
      posted by mark7570 at 12:47 PM on March 21, 2013


      As a professional data wrangler I would like to point out that there is never enough data. This is a false panic.
      posted by fshgrl at 2:49 PM on March 21, 2013 [2 favorites]


      Data are just data. Without a human to create the framework of assumptions around the analysis and interpretation of that analysis, a dataset is a useless lump.

      It is also important to understand the difference between causal inference and prediction. The latter is relatively easy and when predicting what will happen is all you want to do, you don't care about causality. When you care about causal relationships, it gets very complicated and easy to fool yourself. That's when the house comes crashing down around you.
      posted by Mental Wimp at 3:41 PM on March 21, 2013


      Like aren't there useful pieces of information from before 2011?

      When there's failure to account for, blaming it on the computer (or "bad data") has become very popular. On the other hand, credit for success accrues to the Nate Silvers. Same old game, new clothes.
      posted by Twang at 3:42 PM on March 21, 2013


      bonehead: "more physicists and chemists than biologists
      Geologists too: GIS systems are nothing if not Big Data.
      Dealing with Big Data has been one of, if not the, largest change and challenge for the current generation of scientists
      "

      Archaeologists, too! Geospatial data are quite dear to our hearts, and we're starting to acquire a huge amount of data on past behaviors and actions, and where those occurred.

      From a social science standpoint, one of the things I'm loving about some of the massive datasets we're accruing (and here, I am thinking primariy of massive geospatial datasets of archaeological site locations, site components, etc.) is that, contrary to entrenched old schoolers' fears, it's not that simple solutions are falling out of the mass of data. If anything, having a huge amount of data actually complicates and recomplicates the picture to the point that the data can seem to support multiple hypotheses and viewpoints. I love it when things get complicated! Of all things "big" data do, at least from my point of view, simplifying answers is not one of them.

      In a sense, I kinda feel like it's reminiscent of the Philosophers bit towards the end of Hitchhiker's Guide to the Galaxy (edited a bit for brevity, and apologies for the small text so I don't fill too much space, but):
      "Under law the Quest for Ultimate Truth is quite clearly the inalienable prerogative of your working thinkers. Any bloody machine goes and actually finds it and we're straight out of a job aren't we? I mean what's the use of our sitting up half the night arguing that there may or may not be a God if this machine only goes and gives us his bleeding phone number the next morning?" (...)

      "Might I make an observation at this point?" inquired Deep Thought. (...) "it occurs to me that running a programme like this is bound to create an enormous amount of popular publicity
      for the whole area of philosophy in general. Everyone's going to have their own theories about what answer I'm eventually to come up with, and who better to capitalize on that media market than you yourself? So long as you can keep disagreeing with each other violently enough and slagging each other off in the popular press, you can keep yourself on the gravy train for life. How does that sound?"

      The two philosophers gaped at him.

      "Bloody hell," said Majikthise, "now that is what I call thinking. Here Vroomfondel, why do we never think of things like that?"

      "Dunno," said Vroomfondel in an awed whisper, "think our brains must be too highly trained Majikthise."

      So saying, they turned on their heels and walked out of the door and into a lifestyle beyond their wildest dreams.
      posted by barnacles at 10:57 PM on March 21, 2013 [3 favorites]


      Isn't the bulk of (successful) human innovation based on ignoring our often wrong intuition and actually interpreting the data?

      Secondly, the more data there is, the more need there will be for people to interpret it and sift through it intelligently.
      posted by gjc at 6:36 AM on March 22, 2013


      Isn't the bulk of (successful) human innovation based on ignoring our often wrong intuition and actually interpreting the data?

      I don't know about this. I mean, if people are wrong about some fact that there's data about, presumably analyzing the data will reveal that people are wrong, but I'm not sure that's how progress has generally been made.

      The dream that quantification will solve our problems has been around for hundreds of years. It always seems to present itself as something brand new that no one's ever thought of before.

      "Big Data" is an interesting term -- to me it should be restricted to things like data about the entire internet, or the datasets that particle physicists and gene researchers accumulate. People often seem to use the term when they just mean "Data."
      posted by leopard at 7:27 AM on March 22, 2013


      A ¡®Big Data¡¯ Freeway for Scientists
      posted by homunculus at 2:19 PM on March 22, 2013


      Everything We Know About What Data Brokers Know About You

      Discussion: How Do Data Brokers Impact You?
      posted by homunculus at 10:45 AM on March 23, 2013


      Schneier On Security: Our Internet Surveillance State
      The Internet is a surveillance state. Whether we admit it to ourselves or not, and whether we like it or not, we're being tracked all the time. Google tracks us, both on its pages and on other pages it has access to. Facebook does the same; it even tracks non-Facebook users. Apple tracks us on our iPhones and iPads. One reporter used a tool called Collusion to track who was tracking him; 105 companies tracked his Internet use during one 36-hour period.

      Increasingly, what we do on the Internet is being combined with other data about us. Unmasking Broadwell's identity involved correlating her Internet activity with her hotel stays. Everything we do now involves computers, and computers produce data as a natural by-product. Everything is now being saved and correlated, and many big-data companies make money by building up intimate profiles of our lives from a variety of sources.

      Facebook, for example, correlates your online behavior with your purchasing habits offline. And there's more. There's location data from your cell phone, there's a record of your movements from closed-circuit TVs.
      posted by the man of twists and turns at 9:08 AM on March 25, 2013 [1 favorite]


      And welcome to a world where all of this, and everything else that you do or is done on a computer, is saved, correlated, studied, passed around from company to company without your knowledge or consent; and where the government accesses it at will without a warrant.
      Actually, that last part about NSLs may not be true for much longer, depending on what happens with the appeal:

      Federal Judge Finds National Security Letters Unconstitutional, Bans Them
      posted by homunculus at 9:53 AM on March 25, 2013 [1 favorite]


      obligatory
      posted by jeffburdges at 6:44 PM on March 26, 2013


      An Interview With Writer Jaron Lanier
      In the case of a market place, yes. But this is why it is so critical that market places can¡¯t be corrupt and need to be honest. The problem with our cloud software right now is that it does tend to be run by the person with the biggest computer on the network, and serve certain interests more than others. It¡¯s not an honest broker. We are constantly running into a situation where a company like Google is saying: we are being the honest broker. Of course that is ridiculous because they are a commercial concern. So in order for us to be rationally ready to cede control to some cloud software, it really does have to achieve some state of honesty. I believe that should look more like a real market place.
      posted by the man of twists and turns at 9:22 PM on March 27, 2013


      Oh, and the FBI is secretly spying on data in the Cloud butt.
      posted by the man of twists and turns at 9:23 PM on March 27, 2013 [1 favorite]


      What Big Data Will Never Explain
      The mathematization of subjectivity will founder upon the resplendent fact that we are ambiguous beings. We frequently have mixed feelings, and are divided against ourselves. We use different words to communicate similar thoughts, but those words are not synonyms. Though we dream of exactitude and transparency, our meanings are often approximate and obscure. What algorithm will capture ¡°the feel of not to feel it?/?when there is none to heal it,¡± or ¡°half in love with easeful Death¡±?
      posted by the man of twists and turns at 9:49 PM on April 2, 2013 [1 favorite]


      What algorithm will capture ¡°the feel of not to feel it?/?when there is none to heal it,¡± or ¡°half in love with easeful Death¡±?

      Well, our algorithms do, at least for some of us...
      posted by Mental Wimp at 12:01 PM on April 3, 2013


      The New California Act That Would Let Consumers Find Out Who Has Their Personal Data¡ªAnd Get a Copy
      posted by homunculus at 2:39 PM on April 3, 2013 [1 favorite]


      The Real Wisdom Of Crowds - "To Iain Couzin from Princeton University, these stories are a little boring. Everyone is trying to solve a problem, and they do it more accurately together than alone. Whoop-de-doo. By contrast, Couzin has found an example of a more exciting type of collective intelligence¡ªwhere a group solves a problem that none of its members are even aware of. Simply by moving together, the group gains new abilities that its members lack as individuals."
      posted by the man of twists and turns at 6:17 AM on April 5, 2013 [1 favorite]


      The Hidden Biases In Big Data, via
      Sadly, they can't. Data and data sets are not objective; they are creations of human design. We give numbers their voice, draw inferences from them, and define their meaning through our interpretations. Hidden biases in both the collection and analysis stages present considerable risks, and are as important to the big-data equation as the numbers themselves.
      posted by the man of twists and turns at 10:47 AM on April 9, 2013


      Turning Big Data Into Smart Data: 5 Lessons For Marketers From The Obama Campaign
      posted by the man of twists and turns at 5:56 AM on April 11, 2013


      How a Computer Program Can Learn All About You From Just Your Facebook Likes
      Evgeny Morozov: How Facebook Could Get You Arrested
      posted by the man of twists and turns at 1:45 PM on April 20, 2013 [1 favorite]


      « Older What Fresh El is This?   |   Daddy, Daddy, Daddy! Newer »


      This thread has been archived and is closed to new comments




      ¡°Why?¡± asked Larry, in his practical way. "Sergeant," admonished the Lieutenant, "you mustn't use such language to your men." "Yes," accorded Shorty; "we'll git some rations from camp by this evenin'. Cap will look out for that. Meanwhile, I'll take out two or three o' the boys on a scout into the country, to see if we can't pick up something to eat." Marvor, however, didn't seem satisfied. "The masters always speak truth," he said. "Is this what you tell me?" MRS. B.: Why are they let, then? My song is short. I am near the dead. So Albert's letter remained unanswered¡ªCaro felt that Reuben was unjust. She had grown very critical of him lately, and a smarting dislike coloured her [Pg 337]judgments. After all, it was he who had driven everybody to whatever it was that had disgraced him. He was to blame for Robert's theft, for Albert's treachery, for Richard's base dependence on the Bardons, for George's death, for Benjamin's disappearance, for Tilly's marriage, for Rose's elopement¡ªit was a heavy load, but Caro put the whole of it on Reuben's shoulders, and added, moreover, the tragedy of her own warped life. He was a tyrant, who sucked his children's blood, and cursed them when they succeeded in breaking free. "Tell my lord," said Calverley, "I will attend him instantly." HoME²Ô¾®¿Õ·¬ºÅѸÀ×Á´½Ó ENTER NUMBET 0017
      www.mege9.com.cn
      yaer7.net.cn
      bdjc.com.cn
      www.timu4.com.cn
      www.haoji4.com.cn
      www.banri5.com.cn
      www.mucai0.com.cn
      sheda9.com.cn
      ac8news.com.cn
      www.alidcep.com.cn
      成人图片四月色月阁 美女小美操逼 综合图区亚洲 苍井空的蓝色天空 草比wang WWW.BBB471.COM WWW.76UUU.COM WWW.2BQVOD.COM WWW.BASHAN.COM WWW.7WENTA.COM WWW.EHU8.COM WWW.XFW333.COM WWW.XF234.COM WWW.XIXILU9.COM WWW.0755MSX.NET WWW.DGFACAI.COM WWW.44DDYY.COM WWW.1122DX.COM WWW.YKB168.COM WWW.FDJWG.COM WWW.83CCCC.COM WWW.7MTP.COM WWW.NXL7.COM WWW.UZPLN.COM WWW.SEA0362.NET WWW.LUYHA.COM WWW.IXIAWAN.COM WWW.HNJXSJ.COM WWW.53PY.COM WWW.HAOYMAO.COM WWW.97PPP.COM 医网性交动态图 龙腾视频网 骚姐av男人天堂444ckcom wwwvv854 popovodcom sss色手机观看 淫荡之妇 - 百度 亚洲人兽交欧美A片 色妹妹wwwsemm22com 人妻激情p 狼国48Q 亚洲成人理论网 欧美男女av影片 家庭乱伦无需任何播放器在线播放 妩媚的尼姑 老妇成人图片大全 舔姐姐的穴 纯洁小处男 pu285ftp 大哥撸鲁鲁修 咪米色网站 丝袜美腿18P 晚上碰上的足交视频 avav9898 狠狠插影院免费观看所视频有电影 熟女良家p 50s人体 幼女av电影资源种子 小说家庭乱伦校园春色 丝袜美女做爱图片 影音先锋强奸影片 裸贷视频在线观 校园春色卡通动漫的 搜索wwwhuangtvcom 色妹影视 戊人网站 大阴茎男人性恋色网 偷拍自怕台湾妹 AV视频插进去 大胆老奶奶妈妈 GoGo全球高清美女人体 曼娜回忆录全文 上海东亚 舔柯蓝的脚 3344d最近十天更新 av在线日韩有码 强奸乱伦性爱淫秽 淫女谁 2233p 123aaaa查询 福利AV网站 世界黄色网址 弟姐撸人人操 婷婷淫色色淫 淫姐姐手机影院 一个释放的蝌蚪窝超碰 成人速播视频 爱爱王国 黄色一级片影视 夫妻主奴五月天 先锋撸撸吧 Xxoo88 与奶奶的激情 我和老女人美妙经历 淫妻色五月 zaiqqc 和姐姐互舔15p 色黄mp4 先锋2018资源 seoquentetved2k 嫩妹妹色妹妹干妹妹 欧美性爱3751www69nnnncom 淫男乱女小说 东方在线Av成人撸一撸 亚洲成人av伦理 四虎影视二级 3p性交 外国人妖口交性交黑人J吧插女人笔视观看 黑道总裁 人人x艹 美女大战大黑吊 神马电影伦理武则天 大鸡八插进的戏 爆操情人 热颜射国产 真实自拍足交 偷拍萝莉洗澡无码视频 哥哥狠狠射狠狠爱 欲体焚情搜狗 妹子啪啪网站 jizzroutn 平井绘里在线观看 肏男女 五月天逍遥社区 网站 私色房综合网成人网 男人和女人caobi 成人共享网站 港台三级片有逼吗 淫龙之王小说 惠美里大战黑人 我为美女姐姐口交 乱论色站 西田麻衣大胆的人体艺术 亚洲 包射网另类酷文在线 就爱白白胖胖大屁股在线播放 欧美淫妻色色色 奥蕾人艺术全套图片 台湾中学生门ed2k 2013国产幼门 WWW_66GGG_COM WWW_899VV_COM 中国老女人草比 qingse9 nvtongtongwaiyintou 哥哥妹妹性爱av电影 欧美和亚洲裸体做爱 肏胖骚屄 美国十此次先锋做爱影视 亚里沙siro 爆操人妻少妇 性交的骚妇 百度音影动漫美女窝骚 WWW_10XXOO_COM 哥两撸裸体图片 香洪武侠电影 胖美奈 我和女儿日屄 上海礼仪小姐 紫微斗数全书 优酷视频联盟 工作压力大怎么办 成人动漫edk 67ijcom WWW15NVNVCOM 东京热逼图 狠狠干自拍 第五色宗 少妇的b毛 t56人体艺术大胆人体模特 大黄狗与美女快播播放 美女露屄禁图 大胆内射少妇 十二种屄 苍井空绿色大战 WWWAFA789COM 淫老婆3p 橹二哥影院影视先锋 日本h动漫继母在线观看 淫乱村庄 强奸少妇采花魔 小泽玛莉亚乱伦电影 婷婷五月红成人网 我爱色洞洞 和老婆日屄图片 哪个网站能看到李宗瑞全集 操小姨的穴 白洁亚洲图片 亚洲色图淫荡内射美女 国外孕妇radio 哪本小说里有个金瓶经的拉完屎扣扣屁眼闻俩下 在线亚洲邪恶图 快播最新波哆野结依 wwwgigi22com 操紧身妹 丁香五月哥 欧美强奸幼童下载wwwgzyunhecom 撸波波rrr777 淫兽传 水淫穴 哥哥干巨乳波霸中文字幕 母子相奸AV视频录像 淫荡的制服丝袜妈妈 有强奸内容的小黄文 哪里艺术片 刘嘉玲人体艺术大胆写真 www婷婷五月天5252bocom 美女护士动态图片 教师制服诱惑a 黄色激情校园小说 怡红院叶子喋 棚户区嫖妓pronhub 肏逼微博 wwppcc777 vns56666com 色哥哥色妹妹内射 ww99anan 清纯秀气的学生妹喝醉 短头发撸碰 苍井空一级片tupian 够爽影院女生 鲁大娘久草 av淘之类的网站 谷露AV日本AV韩国AV 电台有声小说 丽苑春色 小泽玛利亚英语 bl动漫h网 色谷歌短片 免费成人电影 台湾女星综合网 美眉骚导航(荐) 岛国爱情动作片种子 兔牙喵喵在线观看影院 五月婷婷开心之深深爱一本道 动漫福利啪啪 500导航 自拍 综合 dvdes664影音先锋在线观看 水岛津实透明丝袜 rrav999 绝色福利导航视频 200bbb 同学聚会被轮奸在线视频 性感漂亮的保健品推销员上门推销套套和延迟剂时被客户要求当场实验效果操的 羞羞影院每日黄片 小黄视频免费观看在线播放 日本涩青视频 日本写真视频 日本女人大尺度裸体操逼视频 日韩电影网 日本正在播放女教师 在线观看国产自拍 四虎官方影库 男男a片 小武妈妈 人妻免费 视频日本 日本毛片免费视频观看51影院 波多野结衣av医院百度网盘 秋假影院美国影阮日本 1亚欧成人小视频 奇怪美发沙龙店2莉莉影院 av无码毛片 丝袜女王调教的网站有哪些 2499在线观视频免费观看 约炮少妇视频 上床A级片 美尻 无料 w字 主播小电影视频在线观看 自拍性porn 伦理片日本猜人电影 初犬 无码 特级毛片影谍 日日在线操小妹视频 日本无码乱论视频 kinpatu86 在线 欧美色图狠狠插 唐朝AV国产 校花女神肛门自慰视频 免费城人网站 日产午夜影院 97人人操在线视频 俺来也还有什么类似的 caopron网页 HND181 西瓜影音 阿v天堂网2014 秋霞eusses极速播放 柳州莫菁第6集 磁力链 下载丝袜中文字 IPZ-694 ftp 海牙视频成人 韩国出轨漫画无码 rbd561在线观看 色色色 magnet 冲田杏梨爆乳女教师在线 大桃桃(原蜜桃Q妹)最新高清大秀两套6V XXX日本人体艺术三人 城市雄鹰。你个淫娃 久久最新国产动漫在线 A级高清免费一本道 人妻色图 欧美激情艳舞视频 草莓在线看视频自拍 成电人影有亚洲 ribrngaoqingshipin 天天啪c○m 浣肠video在线观看 天堂av无码av欧美av免费看电影 ftxx00 大香蕉水 吉里吉里电影网 日本三级有码视频 房事小视频。 午午西西影院 国内自拍主播 冲田爱佳 经典拳交视频最新在线视频 怡红影晥免费普通用户 青娱乐综合在线观看 藏经阁成人 汤姆影视avtom wwWff153CoM 一本道小视频免费 神马影影院大黄蜂 欧美老人大屁股在线 四级xf 坏木啪 冲田杏梨和黑人bt下载 干莉莉 桃乃木香奈在线高清ck 桑拿888珠海 家庭乱伦视频。 小鸟酱自慰视频在线观看 校园春色 中文字幕 性迷宫0808 迅雷资源来几个 小明看看永久免费视频2 先锋hunta资源 国产偷拍天天干 wwwsezyz4qiangjianluanlun 婷婷五月社区综合 爸爸你的鸡巴太大轻点我好痛 农村妇女买淫视屏 西瓜网赤井美月爆乳女子在校生 97无码R级 日本图书馆暴力强奸在线免费 巨乳爱爱在线播放 ouzouxinjiao 黄色国产视频 成人 自拍 超碰 在线 腿绞论坛 92福利电影300集 人妻x人妻动漫在线 进入 91视频 会计科目汇总表人妻x人妻动漫在线 激情上位的高颜值小少妇 苹果手机能看的A片 一本道av淘宝在线 佐藤美纪 在线全集 深夜成人 国内自拍佛爷在线 国内真实换妻现场实拍自拍 金瓶梅漫画第九话无码 99操人人操 3737电影网手机在线载 91另类视频 微兔云 (指甲油) -(零食) ssni180迅雷中字 超清高碰视频免费观看 成人啪啪小视频网址 美女婶婶当家教在线观看 网红花臂纹身美女大花猫SM微拍视频 帅哥美女搞基在床上搞的视频下载东西 日本视频淫乱 av小视频av小电影 藤原辽子在线 川上优被强奸电影播放 长时间啊嗯哦视频 美女主播凌晨情趣套装开车,各种自·慰加舞技 佳色影院 acg乡村 国产系列欧美系列 本土成人线上免费影片 波罗野结衣四虎精品在线 爆乳幼稚园 国产自拍美女在线观看免插件 黑丝女优电影 色色的动漫视频 男女抽插激情视频 Lu69 无毛伦理 粉嫩少妇9P 欧美女人开苞视频 女同a级片 无码播放 偷拍自拍平板 天天干人人人人干 肏多毛的老女人 夜人人人视频 动漫女仆被揉胸视频 WWW2018AVCOM jizzjizzjizz马苏 巨乳潜入搜查官 藤浦惠在线观看 老鸹免费黄片 美女被操屄视频 美国两性 西瓜影音 毛片ok48 美国毛片基地A级e片 色狼窝图片网 泷泽乃南高清无码片 热热色源20在线观看 加勒比澳门网 经典伦理片abc 激情视频。app 三百元的性交动画 97爱蜜姚网 雷颖菲qq空间 激情床戏拍拍拍 luoli hmanh 男人叉女人视频直播软件 看美女搞基哪个app好 本网站受美坚利合众国 caobike在线视频发布站 女主播电击直肠两小时 狠狠干高清视频在线观看 女学生被强奸的视频软件 欧美喷水番号 欧美自拍视频 武侠古典伦理 m13113美女图片 日本波多野结衣三级无马 美女大桥AV隐退 在线中文字幕亚洲欧美飞机图 xxx,av720p iav国产自拍视频 国内偷拍视频在线 - 百度 国歌产成人网 韩国美女主播录制0821 韩国直播av性 fyeec日本 骚逼播放 偷拍你懂的网站 牡蛎写真视频 初川南个人资源 韩国夏娃 ftp 五十度飞2828 成人区 第五季 视频区 亚洲日韩 中文字幕 动漫 7m视频分类大全电影 动漫黄片10000部免费视频 我骚逼丝袜女网友给上了 日本女人的性生活和下水道囧图黄 肏婶骚屄 欧美美女性爰图 和美女明星做爱舒服吗 乱伦小说小姨 天天舅妈 日本极品淫妇美鲍人体艺术 黄色录像强奸片 逍遥仙境论坛最新地址 人插母动物 黄s页大全 亚洲无码电影网址 幼女乱伦电影 雯雅婷30p caopran在线视频 插b尽兴口交 张佰芝yinbu biantaicaobitupian 台湾18成人电影 勾引同学做爱 动态性交姿势图 日本性交图10p 操逼动态图大全 国产后入90后 quanjialuanlun 裸女条河图片种子 坚挺的鸡吧塞进少妇的骚穴 迅雷亚洲bt www56com 徐老板去农村玩幼女小说故事 大尺度床吻戏大全视频 wwwtp2008com 黑丝大奶av 口述与爸爸做爱 人兽完全插入 欧美大乳12p 77hp 教师 欧美免费黄色网 影音先锋干女人逼 田中瞳无码电影 男人与漂亮的小母 在线观看 朴妮唛骚逼 欧美性感骚屄浪女 a片马干人 藤原绘里香电影 草草逼网址 www46xxxcn 美女草屄图 色老太人体艺网 男人的大阴茎插屄 北京违章车辆查询 魅影小说 滨岛真绪zhongzi 口比一级片 国产a片电影在线播放 小说我给男友刮毛 做爱视屏 茜木铃 开心四色播播网影视先锋 影音先锋欧美性爱人与兽 激情撸色天天草 插小嫚逼电影 人与动物三客优 日本阴部漫画美女邪恶图裸体护士美女露阴部 露屄大图 日韩炮图图片 欧美色图天天爱打炮 咪咕网一路向西国语 一级激情片 我爱看片av怎么打不开 偷拍自拍影先锋芳芳影院 性感黑丝高跟操逼 女性阴部摄影图片 自拍偷拍作爱群交 我把大姨给操了 好色a片 大鸡吧黄片 操逼和屁眼哪个爽 先生肉感授业八木梓 国产电影色图 色吧色吧图片 祖母乱伦片 强悍的老公搞了老婆又搞女儿影音先锋 美女战黑人大鸟五月 我被大鸡吧狂草骚穴 黄狗猪性交妇 我爱少女的逼 伦理苍井空百度影音 三姨妈的肥 国产成人电影有哪些 偷拍自拍劲爆欧美 公司机WWW日本黄色 无遮挡AV片 sRAV美女 WLJEEE163com 大鸡巴操骚12p 我穿着黑丝和哥哥干 jiujiucaojiujiucao 澳门赌场性交黄色免费视频 sifangplanxyz 欧美人兽交asianwwwzooasiancomwwwzootube8com 地狱少女新图 美女和黄鳝xxx doingit电影图片 香港性爱电影盟 av电影瑜伽 撸尔山乱伦AV 天天天天操极品好身材 黑人美女xxoo电影 极品太太 制服诱惑秘书贴吧 阿庆淫传公众号 国产迟丽丽合集 bbw热舞 下流番号 奥门红久久AV jhw04com 香港嫩穴 qingjunlu3最新网 激情做爱动画直播 老师大骚逼 成人激情a片干充气娃娃的视频 咪图屋推女郎 AV黄色电影天堂 aiai666top 空姐丝袜大乱11p 公公大鸡巴太大了视频 亚洲午夜Av电影 兰桂坊女主播 百度酷色酷 龙珠h绿帽 女同磨豆腐偷拍 超碰男人游戏 人妻武侠第1页 中国妹妹一级黄片 电影女同性恋嘴舔 色秀直播间 肏屄女人的叫声录音 干她成人2oP 五月婷婷狼 那里可以看国内女星裸照 狼友最爱操逼图片 野蛮部落的性生活 人体艺术摄影37cc 欧美色片大色站社区 欧美性爱喷 亚洲无码av欧美天堂网男人天堂 黑人黄色网站 小明看看主 人体艺术taosejiu 1024核工厂xp露出激情 WWWDDFULICOM 粉嫩白虎自慰 色色帝国PK视频 美国搔女 视频搜索在线国产 小明算你狠色 七夜郎在线观看 亚洲色图欧美色图自拍偷拍视频一区视频二区 pyp影yuan 我操网 tk天堂网 亚洲欧美射图片65zzzzcom 猪jb 另类AV南瓜下载 外国的人妖网站 腐女幼幼 影音先锋紧博资源 快撸网87 妈妈5我乱论 亚洲色~ 普通话在线超碰视频下载 世界大逼免费视频 先锋女优图片 搜索黄色男的操女人 久久女优播免费的 女明星被P成女优 成人三级图 肉欲儿媳妇 午夜大片厂 光棍电影手机观看小姨子 偷拍自拍乘人小说 丝袜3av网 Qvodp 国产女学生做爱电影 第四色haoav 催眠赵奕欢小说 色猫电影 另类性爱群交 影像先锋 美女自慰云点播 小姨子日B乱伦 伊人成人在线视频区 干表姐的大白屁股 禁室义母 a片丝袜那有a片看a片东京热a片q钬 香港经典av在线电影 嫩紧疼 亚洲av度 91骚资源视频免费观看 夜夜日夜夜拍hhh600com 欧美沙滩人体艺术图片wwwymrtnet 我给公公按摩 吉沢明涉av电影 恋夜秀晨间电影 1122ct 淫妻交换长篇连载 同事夫妇淫乱大浑战小说 kk原创yumi www774n 小伙干美国大乳美女magnet 狗鸡巴插骚穴小说 七草千岁改名微博 满18周岁可看爱爱色 呱呱下载 人妻诱惑乱伦电影 痴汉图书馆5小说 meinvsextv www444kkggcom AV天堂手机迅雷下载 干大姨子和二姨子 丝袜夫人 qingse 肥佬影音 经典乱伦性爱故事 日日毛资源站首页 美国美女裸体快播 午夜性交狂 meiguomeishaonvrentiyishu 妹妹被哥哥干出水 东莞扫黄女子图片 带毛裸照 zipailaobishipin 人体艺术阴部裸体 秘密 强奸酒醉大奶熟女无码全集在线播放 操岳母的大屄 国产少妇的阴毛 影音先锋肥熟老夫妻 女人潮吹视频 骚老师小琪迎新舞会 大奶女友 杨幂不雅视频种子百度贴吧 53kk 俄罗斯骚穴 国模 露逼图 李宗瑞78女友名单 二级片区视频观看 爸爸妈妈的淫荡性爱 成人电影去也 华我想操逼 色站图片看不了 嫖娼色 肛交lp 强奸乱伦肏屄 肥穴h图 岳母 奶子 妈妈是av女星 淫荡性感大波荡妇图片 欧美激情bt专区论坛 晚清四大奇案 日啖荔枝三百颗作者 三国防沉迷 印度新娘大结局 米琪人体艺术 夜夜射婷婷色在线视频 www555focom 台北聚色网 搞穴影音先锋 美吻影院超体 女人小穴很很日 老荡妇高跟丝袜足交 越南大胆室内人体艺术 翔田千里美图 樱由罗种子 美女自摸视频下载 香港美女模特被摸内逼 朴麦妮高清 亚寂寞美女用手指抠逼草莓 波多野结衣无码步兵在线 66女阴人体图片 吉吉影音最新无码专区 丝袜家庭教师种子 黄色网站名jane 52av路com 爱爱谷色导航网 阳具冰棒 3334kco 最大胆的人体摄影网 哥哥去在线乱伦文学 婶婶在果园里把我了 wagasetu 我去操妹 点色小说激 色和哥哥 吴清雅艳照 白丝护士ed2k 乱伦小说综合资源网 soso插插 性交抽插图 90后艳照门图片 高跟鞋97色 美女美鲍人体大胆色图 熟女性交bt 百度美女裸体艺术作品 铃木杏里高潮照片图 洋人曹比图 成人黄色图片电影网 幼幼女性性交 性感护士15p 白色天使电影 下载 带性视频qq 操熟女老师 亚洲人妻岛国线播放 虐待荡妇老婆 中国妈妈d视频 操操操成人图片 大阴户快操我 三级黄图片欣赏 jiusetengmuziluanlun p2002午夜福 肉丝一本道黑丝3p性爱 美丽叔母强奸乱伦 偷拍强奸轮奸美女短裙 日本女人啪啪网址 岛国调教magnet 大奶美女手机图片 变态强奸视频撸 美女与色男15p 巴西三级片大全 苍井空点影 草kkk 激情裸男体 东方AV在线岛国的搬运工下载 青青草日韩有码强奸视频 霞理沙无码AV磁力 哥哥射综合视频网 五月美女色色先锋 468rccm www色红尘com av母子相奸 成人黄色艳遇 亚洲爱爱动漫 干曰本av妇女 大奶美女家教激情性交 操丝袜嫩b 有声神话小说 小泽玛利亚迅雷 波多野结衣thunder 黄网色中色 www访问www www小沈阳网com 开心五月\u0027 五月天 酒色网 秘密花园 淫妹影院 黄黄黄电影 救国p2p 骚女窝影片 处女淫水乱流 少女迷奸视频 性感日本少妇 男人的极品通道 色系军团 恋爱操作团 撸撸看电影 柳州莫菁在线视频u 澳门娱银河成人影视 人人莫人人操 西瓜视频AV 欧美av自拍 偷拍 三级 狼人宝鸟视频下载 妹子漏阴道不打码视频 国产自拍在线不用 女牛学生破处視频 9877h漫 七色沙耶香番号 最新国产自拍 福利视频在线播放 青青草永久在线视频2 日本性虐电影百度云 pppd 481 snis939在线播放 疯狂性爱小视频精彩合集推荐 各种爆操 各种场所 各式美女 各种姿势 各式浪叫 各种美乳 谭晓彤脱黑奶罩视频 青青草伊人 国内外成人免费影视 日本18岁黄片 sese820 无码中文字幕在线播放2 - 百度 成语在线av 奇怪美发沙龙店2莉莉影院 1人妻在线a免费视频 259luxu在线播放 大香蕉综合伊人网在线影院 国模 在线视频 国产 同事 校园 在线 浪荡女同做爱 healthonline899 成人伦理 mp4 白合野 国产 迅雷 2018每日在线女优AV视频 佳AV国产AV自拍日韩AV视频 色系里番播放器 有没有在线看萝莉处女小视频的网站 高清免费视频任你搞伦理片 温泉伦理按摸无码 PRTD-003 时间停止美容院 计女影院 操大白逼baby操作粉红 ak影院手机版 91老司机sm 毛片基地成人体验区 dv1456 亚洲无限看片区图片 abp582 ed2k 57rrrr新域名 XX局长饭局上吃饱喝足叫来小情人当众人面骑坐身上啪啪 欲脱衣摸乳给众人看 超震撼 处女在线免费黄色视频 大香巨乳家政爱爱在线 吹潮野战 处女任务坉片 偷拍视频老夫妻爱爱 yibendaoshipinzhaixian 小川阿佐美再战 内人妻淫技 magnet 高老庄八戒影院 xxxooo日韩 日韩av12不卡超碰 逼的淫液 视频 黎明之前 ftp 成人电影片偷拍自拍 久久热自拍偷在线啪啪无码 2017狼人干一家人人 国产女主播理论在线 日本老黄视频网站 少妇偷拍点播在线 污色屋在线视频播放 狂插不射 08新神偷古惑仔刷钱BUG 俄罗斯强姦 在线播放 1901福利性爱 女人59岁阴部视频 国产小视频福利在线每天更新 教育网人体艺术 大屁股女神叫声可射技术太棒了 在线 极品口暴深喉先锋 操空姐比 坏木啪 手机电影分分钟操 jjzyjj11跳转页 d8视频永久视频精品在线 757午夜视频第28集 杉浦花音免费在线观看 学生自拍 香蕉视频看点app下载黄色片 2安徽庐江教师4P照片 快播人妻小说 国产福二代少妇做爱在线视频 不穿衣服的模特58 特黄韩国一级视频 四虎视频操逼小段 干日本妇妇高清 chineseloverhomemade304 av搜搜福利 apaa-186 magnet 885459com63影院 久久免费视怡红院看 波多野结衣妻ネトリ电影 草比视频福利视频 国人怡红院 超碰免费chaopeng 日本av播放器 48qa,c 超黄色裸体男女床上视频 PPPD-642 骑马乳交插乳抽插 JULIA 最后是厉害的 saob8 成人 inurl:xxx 阴扩 成八动漫AV在线 shawty siri自拍在线 成片免费观看大香蕉 草莓100社区视频 成人福利软件有哪些 直播啪啪啪视频在线 成人高清在线偷拍自拍视频网站 母女午夜快播 巨乳嫩穴影音先锋在线播放 IPZ-692 迅雷 哺乳期天天草夜夜夜啪啪啪视频在线 孩子放假前与熟女的最后一炮 操美女25p freex性日韩免费视频 rbd888磁力链接 欧美美人磁力 VR视频 亚洲无码 自拍偷拍 rdt在线伦理 日本伦理片 希崎杰西卡 被迫服从我的佐佐凌波在线观看 葵つか步兵在线 东方色图, 69堂在线视频 人人 abp356百度云 江媚玲三级大全 开心色导 大色哥网站 韩国短发电影磁力 美女在线福利伦理 亚洲 欧美 自拍在线 限制级福利视频第九影院 美女插鸡免得视频 泷泽萝拉第四部第三部我的邻居在线 色狼窝综合 美国少妇与水电工 火影忍者邪恶agc漫画纲手邪恶道 近亲乱伦视频 金卡戴珊视频门百度云 极虎彯院 日本 母乳 hd 视频 爆米花神马影院伦理片 国产偷拍自拍丝袜制服无码性交 璩美凤光碟完整版高清 teen萝莉 国产小电影kan1122 日日韩无码中文亚洲在线视频六区第6 黄瓜自卫视频激情 红番阔午夜影院 黄色激情视频网视频下载 捆梆绳模羽洁视频 香蕉视频页码 土豆成人影视 东方aⅴ免费观看p 国内主播夫妻啪啪自拍 国内网红主播自拍福利 孩子强奸美女软件 廿夜秀场面业影院 演员的诞生 ftp 迷奸系列番号 守望人妻魂 日本男同调教播放 porn三级 magnet 午夜丁香婷婷 裸卿女主播直播视频在线 ac制服 mp4 WWW_OSION4YOU_COM 90后人体艺术网 狠狠碰影音先锋 美女秘书加班被干 WWW_BBB4444_COM vv49情人网 WWW_XXX234_COM 黄色xxoo动态图 人与动物性交乱伦视频 屄彩图