Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-10888

[Umbrella] New capacity modes for CS

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 3.4.0
    • 3.4.0
    • capacity scheduler
    • None
    • Reviewed

    Description

      Investigate how resource allocation configuration could be more consistent in CapacityScheduler

      It would be nice if everywhere where a capacity can be defined could be defined the same way:

      • With fixed amounts (e.g. 1 GB memory, 8 vcores, 3 GPU)
      • With percentages
        • Percentage of all resources (eg 10% of all memory, vcore, GPU)
        • Percentage per resource type (eg 10% memory, 25% vcore, 50% GPU)
      • Allow mixing different modes under one hierarchy but not under the same parent queues.

      We need to determine all configuration options where capacities can be defined, and see if it is possible to extend the configuration, or if it makes sense in that case.

      Attachments

        Issue Links

          Activity

            People

              bteke Benjamin Teke
              snemeth Szilard Nemeth
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 15h 10m
                  15h 10m