Generics based Framework for Composing and Submitting .Net Hadoop MapReduce Jobs
To enable non-Java based MapReduce jobs Hadoop supports a Streaming interface. To better support this interface in .Net I have constructed a composable framework to enable one to submit .Net based MapReduce jobs whilst only writing Mappers and Reducers types.
Currently the base type for teh Mapper is along the lines of:
I was thinking of changing this to be something like
MapperBase<V1, V2> where V1 : String, XDocument, Stream
Based on the type the underlying EXE could then be called.
Help us improve MSDN.
Visit our UserVoice Page to submit and vote on ideas!