Knowee
Questions
Features
Study Tools

challenges and limitations of big data

Question

challenges and limitations of big data

🧐 Not the exact question you are looking for?Go ask a question

Solution

Sure, here are some challenges and limitations of big data:

  1. Data Quality and Accuracy: One of the biggest challenges is ensuring the data is high quality and accurate. This can be difficult due to the sheer volume of data, as well as the variety of sources from which it comes.

  2. Data Security: With large amounts of data comes the need for strong security measures. This can be a challenge as it requires significant resources and expertise to ensure data is kept safe from breaches and attacks.

  3. Data Privacy: Related to security is the issue of privacy. With more data being collected, there is a greater risk of sensitive information being exposed. This is a major concern for individuals and businesses alike.

  4. Data Storage and Processing: The sheer volume of big data can make storage and processing a challenge. Traditional data processing applications are not equipped to handle such large amounts of data.

  5. Lack of Skilled Personnel: There is a shortage of skilled data scientists and analysts who can effectively analyze and interpret big data. This can limit the potential benefits of big data.

  6. Integration of Data: Big data comes from various sources and in various formats. Integrating this data can be a complex and time-consuming process.

  7. Cost: The cost of storing and processing big data can be high. This can be a barrier for smaller businesses that may not have the necessary resources.

  8. Understanding the Data: Even with the right tools and personnel, understanding what the data is telling you can be a challenge. It requires a deep understanding of the business and the industry to make sense of the data.

  9. Regulatory Issues: There are various laws and regulations regarding data collection, storage, and use. Navigating these can be a challenge, especially for businesses operating in multiple jurisdictions.

This problem has been solved

Similar Questions

big data storage

Verified Answer

Big Data Management: Challenges and Solutions

Applications of Big data analytic

What is Big Data

Challenges and Opportunities with Big Data11. IntroductionWe are awash in a flood of data today. In a broad range of application areas, data is beingcollected at unprecedented scale. Decisions that previously were based on guesswork, or onpainstakingly constructed models of reality, can now be made based on the data itself. Such Big Dataanalysis now drives nearly every aspect of our modern society, including mobile services, retail,manufacturing, financial services, life sciences, and physical sciences.Scientific research has been revolutionized by Big Data [CCC2011a]. The Sloan Digital Sky Survey[SDSS2008] has today become a central resource for astronomers the world over. The field ofAstronomy is being transformed from one where taking pictures of the sky was a large part of anastronomer’s job to one where the pictures are all in a database already and the astronomer’s task is tofind interesting objects and phenomena in the database. In the biological sciences, there is now a well-­‐established tradition of depositing scientific data into a public repository, and also of creating publicdatabases for use by other scientists. In fact, there is an entire discipline of bioinformatics that is largelydevoted to the curation and analysis of such data. As technology advances, particularly with the adventof Next Generation Sequencing, the size and number of experimental data sets available is increasingexponentially.Big Data has the potential to revolutionize not just research, but also education [CCC2011b]. Arecent detailed quantitative comparison of different approaches taken by 35 charter schools in NYC hasfound that one of the top five policies correlated with measurable academic effectiveness was the use ofdata to guide instruction [DF2011]. Imagine a world in which we have access to a huge database wherewe collect every detailed measure of every student's academic performance. This data could be used todesign the most effective approaches to education, starting from reading, writing, and math, toadvanced, college-­‐level, courses. We are far from having access to such data, but there are powerfultrends in this direction. In particular, there is a strong trend for massive Web deployment ofeducational activities, and this will generate an increasingly large amount of detailed data aboutstudents' performance.It is widely believed that the use of information technology can reduce the cost of healthcarewhile improving its quality [CCC2011c], by making care more preventive and personalized and basing iton more extensive (home-­‐based) continuous monitoring. McKinsey estimates [McK2011] a savings of300 billion dollars every year in the US alone.In a similar vein, there have been persuasive cases made for the value of Big Data for urbanplanning (through fusion of high-­‐fidelity geographical data), intelligent transportation (through analysisand visualization of live and detailed road network data), environmental modeling (through sensornetworks ubiquitously collecting data) [CCC2011d], energy saving (through unveiling patterns of use),smart materials (through the new materials genome initiative [MGI2011]), computational social sciences15[PCAST2010] Designing a Digital Future: Federally Funded Research and Development in Networkingand Information Technology. PCAST Report, Dec. 2010. Available athttp://www.whitehouse.gov/sites/default/files/microsites/ostp/pcast-­‐nitrd-­‐report-­‐2010.pdf[SDSS2008] SDSS-­‐III: Massive Spectroscopic Surveys of the Distant Universe, the Milky Way Galaxy,and Extra-­‐Solar Planetary Systems. Jan. 2008. Available athttp://www.sdss3.org/collaboration/description.pdf16About this DocumentThis white paper was created through a distributed conversation among many prominent researcherslisted below. This conversation lasted a period of approximately three months from Nov. 2011 to Feb.2012. Collaborative writing was supported by a distributed document editor.Divyakant Agrawal, UC Santa BarbaraPhilip Bernstein, MicrosoftElisa Bertino, Purdue Univ.Susan Davidson, Univ. of PennsylvaniaUmeshwar Dayal, HPMichael Franklin, UC BerkeleyJohannes Gehrke, Cornell Univ.Laura Haas, IBMAlon Halevy, GoogleJiawei Han, UIUCH. V. Jagadish, Univ. of Michigan (Coordinator)Alexandros Labrinidis, Univ. of PittsburghSam Madden, MITYannis Papakonstantinou, UC San Diego

1/3

Upgrade your grade with Knowee

Get personalized homework help. Review tough concepts in more detail, or go deeper into your topic by exploring other relevant questions.