Explain DATA WRANGLING: Also, data munging. The conversion of data, often through the use of scripting languages, to make it easier to work with. If you have 900,000 birthYear values of the format yyyy-mm-dd and 100,000 of the format mm/dd/yyyy and you write a Perl script to convert the latter to look like the former so that you can use them all together, you're doing data wrangling. Discussions of data science often bemoan the high percentage of time that practitioners must spend doing data wrangling; the discussions then recommend the hiring of data engineers to address this. See also Perl, Python, shell, data engineer.
Different definitions in web development like data wrangling in Dictionary D.
- Manual Data Science:
- Meaning extract knowledge and insights from large and complex data sets.”[patil] Data science work often requires knowledge of both statistics and software engineering. See also data engineer, machine data wrangling.
- Manual Dimension Reduction:
- Meaning dimensionality reduction. “We can use a technique called principal component analysis to extract one or more dimensions that capture as much of the variation in the data as possible... Dimensionality data wrangling.
- Manual Deep Learning:
- Meaning level algorithm that gradually identifies things at higher levels of abstraction. For example, the first level may identify certain lines, then the next level identifies combinations of lines as data wrangling.
- Manual Discrete Variable:
- Meaning potential values must be one of a specific number of values. If someone rates a movie with between one and five stars, with no partial stars allowed, the rating is a discrete variable. In a graph data wrangling.
- Manual Data Engineer:
- Meaning data wrangling. “Data engineers are the ones that take the messy data... and build the infrastructure for real, tangible analysis. They run ETL software, marry data sets, enrich and clean all that data wrangling.
