COMPSCI 61A Study Guide - Final Guide: Mapreduce, Execution Model, Standard Streams

40 views1 pages
26 Jan 2018
School
Professor
zogo39484755 and 6 others unlocked
COMPSCI 61A Full Course Notes
22
COMPSCI 61A Full Course Notes
Verified Note
22 documents

Document Summary

Systems : stable consistent interface to unreliable hardware. Networks provide robust data transfer interface to evolving communications intastwume. Databases declarative interface to complex software that stores and retrieves information efficiently ex . Sql: distributed systems unified interface to a duster of multiple machines. Todays iec ! all these hide complexity but retain flexibility. : many smalls tools combine via pipes process like a function standard. 3 : standard streams similar to iterators input provides lines and process can ask for another line when its ready and outputs lines as it processes gun & bad. Unn streams as files file allows iteration read , write. Using these files lab advantage of the os text processing abstractions. Any unix output program can be a linux input input. Big data describes comprehensive log of some aspect of human behavior lwond. Apachespark data processing system that provides a simple interface for large data.