The NSF XSEDE project will be ending on August 31, 2022 and the new ACCESS project will begin September 1, 2022. Consult Allocation Announcements for key dates related to the XSEDE to ACCESS transition. See Advance to ACCESS for additional information about the new project.

The discussion forums in the XSEDE User Portal are for users to share experiences, questions, and comments with other users and XSEDE staff. Visitors are welcome to browse and search, but you must login to contribute to the forums. While XSEDE staff monitor the lists, XSEDE does not guarantee that questions will be answered. Please note that the forums are not a replacement for formal support or bug reporting procedures through the XSEDE Help Desk. You must be logged in to post to the user forums.

« Back

Running MapReduce on multicore in hadoop 2.6

Combination View Flat View Tree View
Threads [ Previous | Next ]
I am trying to run a MapReduce application in a single node machine and utilize its multicore to act as mapper and reducer. I am setting it in the following way:

Configuration conf = new Configuration();
conf.set("", String.valueOf(NO_OF_MAPPERS));
conf.set("mapreduce.tasktracker.reduce.tasks.maximum", String.valueOf(NO_OF_REDUCERS));

I am not sure whether I am doing it right because I don't see any performance increase by using a higher number of mappers and reducers. Can anyone help me? Any help is highly appreciated.