7a09479fb5
* Replace audio whenever set via source * add H264_qsv&HEVC_qsv (#768) * Update ffmpeg.py * Update choices.py * Update typing.py * Fix spaces and newlines * Fix return type * Introduce hififace swapper * Disable stream for expression restorer * Webcam polishing part1 (#796) * Cosmetics on ignore comments * Testing for replace audio * Testing for restore audio * Testing for restore audio * Fix replace_audio() * Remove shortest and use fixed video duration * Remove shortest and use fixed video duration * Prevent duplicate entries to local PATH * Do hard exit on invalid args * Need for Python 3.10 * Fix state of face selector * Fix OpenVINO by aliasing GPU.0 to GPU * Fix OpenVINO by aliasing GPU.0 to GPU * Fix/age modifier styleganex 512 (#798) * fix * styleganex template * changes * changes * fix occlusion mask * add age modifier scale * change * change * hardcode * Cleanup * Use model_sizes and model_templates variables * No need for prepare when just 2 lines of code * Someone used spaces over tabs * Revert back [0][0] --------- Co-authored-by: harisreedhar <h4harisreedhar.s.s@gmail.com> * Feat/update gradio5 (#799) * Update to Gradio 5 * Remove overrides for Gradio * Fix dark mode for Gradio * Polish errors * More styles for tabs and co * Make slider inputs and reset like a unit * Make slider inputs and reset like a unit * Adjust naming * Improved color matching (#800) * aura fix * fix import * move to vision.py * changes * changes * changes * changes * further reduction * add test * better test * change name * Minor cleanup * Minor cleanup * Minor cleanup * changes (#801) * Switch to official assets repo * Add __pycache__ to gitignore * Gradio pinned python-multipart to 0.0.12 * Update dependencies * Feat/temp path second try (#802) * Terminate base directory from temp helper * Partial adjust program codebase * Move arguments around * Make `-j` absolete * Resolve args * Fix job register keys * Adjust date test * Finalize temp path * Update onnxruntime * Update dependencies * Adjust color for checkboxes * Revert due terrible performance * Fix/enforce vp9 for webm (#805) * Simple fix to enforce vp9 for webm * Remove suggest methods from program helper * Cleanup ffmpeg.py a bit * Update onnxruntime (second try) * Update onnxruntime (second try) * Remove cudnn_conv_algo_search tweaks * Remove cudnn_conv_algo_search tweaks * changes * add both mask instead of multiply * adaptive color correction * changes * remove model size requirement * changes * add to facefusion.ini * changes * changes * changes * Add namespace for dfm creators * Release five frame enhancer models * Remove vendor from model name * Remove vendor from model name * changes * changes * changes * changes * Feat/download providers (#809) * Introduce download providers * update processors download method * add ui * Fix CI * Adjust UI component order, Use download resolver for benchmark * Remove is_download_done() * Introduce download provider set, Remove choices method from execution, cast all dict keys() via list() * Fix spacing --------- Co-authored-by: harisreedhar <h4harisreedhar.s.s@gmail.com> * Fix model paths for 3.1.0 * Introduce bulk-run (#810) * Introduce bulk-run * Make bulk run bullet proof * Integration test for bulk-run * new alignment * Add safer global named resolve_file_pattern() (#811) * Allow bulk runner with target pattern only * changes * changes * Update Python to 3.12 for CI (#813) * changes * Improve NVIDIA device lookups * Rename template key to deepfacelive * Fix name * Improve resolve download * Rename bulk-run to batch-run * Make deep swapper inputs universal * Add more deepfacelive models * Use different morph value * Feat/simplify hashes sources download (#814) * Extract download directory path from assets path * Fix lint * Fix force-download command, Fix urls in frame enhancer * changes * fix warp_face_by_bounding_box dtype error * DFM Morph (#816) * changes * Improve wording, Replace [None], SideQuest: clean forward() of age modifier * SideQuest: clean forward() of face enhancer --------- Co-authored-by: henryruhs <info@henryruhs.com> * Fix preview refresh after slide * Add more deepfacelive models (#817) * Add more deepfacelive models * Add more deepfacelive models * Fix deep swapper sizes * Kill accent colors, Number input styles for Chrome * Simplify thumbnail-item looks * Fix first black screen * Introduce model helper * ci.yml: Add macOS on ARM64 to the testing (#818) * ci.yml: Add macOS on ARM64 to the testing * ci.yml: uses: AnimMouse/setup-ffmpeg@v1 * ci.yml: strategy: matrix: os: macos-latest, * - name: Set up FFmpeg * Update .github/workflows/ci.yml * Update ci.yml --------- Co-authored-by: Henry Ruhs <info@henryruhs.com> * Show/hide morph slider for deep swapper (#822) * remove dfl_head and update dfl_whole_face template * Add deep swapper models by Mats * Add deep swapper models by Druuzil * Add deep swapper models by Rumateus * Implement face enhancer weight for codeformer, Side Quest: has proces… (#823) * Implement face enhancer weight for codeformer, Side Quest: has processor checks * Fix typo * Fix face enhancer blend in UI * Use static model set creation * Add deep swapper models by Jen * Introduce create_static_model_set() everywhere (#824) * Move clear over to the UI (#825) * Fix model key * Undo restore_audio() * Switch to latest XSeg * Switch to latest XSeg * Switch to latest XSeg * Use resolve_download_url() everywhere, Vanish --skip-download flag * Fix resolve_download_url * Fix space * Kill resolve_execution_provider_keys() and move fallbacks where they belong * Kill resolve_execution_provider_keys() and move fallbacks where they belong * Remove as this does not work * Change TempFrameFormat order * Fix CoreML partially * Remove duplicates (Rumateus is the creator) * Add deep swapper models by Edel * Introduce download scopes (#826) * Introduce download scopes * Limit download scopes to force-download command * Change source-paths behaviour * Fix space * Update README * Rename create_log_level_program to create_misc_program * Fix wording * Fix wording * Update dependencies * Use tolerant for video_memory_strategy in benchmark * Feat/ffmpeg with progress (#827) * FFmpeg with progress bar * Fix typing * FFmpeg with progress bar part2 * Restore streaming wording * Change order in choices and typing * Introduce File using list_directory() (#830) * Feat/local deep swapper models (#832) * Local model support for deep swapper * Local model support for deep swapper part2 * Local model support for deep swapper part3 * Update yet another dfm by Druuzil * Refactor/choices and naming (#833) * Refactor choices, imports and naming * Refactor choices, imports and naming * Fix styles for tabs, Restore toast * Update yet another dfm by Druuzil * Feat/face masker models (#834) * Introduce face masker models * Introduce face masker models * Introduce face masker models * Register needed step keys * Provide different XSeg models * Simplify model context * Fix out of range for trim frame, Fix ffmpeg extraction count (#836) * Fix out of range for trim frame, Fix ffmpeg extraction count * Move restrict of trim frame to the core, Make sure all values are within the range * Fix and merge testing * Fix typing * Add region mask for deep swapper * Adjust wording * Move FACE_MASK_REGIONS to choices * Update dependencies * Feat/download provider fallback (#837) * Introduce download providers fallback, Use CURL everywhre * Fix CI * Use readlines() over readline() to avoid while * Use readlines() over readline() to avoid while * Use readlines() over readline() to avoid while * Use communicate() over wait() * Minor updates for testing * Stop webcam on source image change * Feat/webcam improvements (#838) * Detect available webcams * Fix CI, Move webcam id dropdown to the sidebar, Disable warnings * Fix CI * Remove signal on hard_exit() to prevent exceptions * Fix border color in toast timer * Prepare release * Update preview * Update preview * Hotfix progress bar --------- Co-authored-by: DDXDB <38449595+DDXDB@users.noreply.github.com> Co-authored-by: harisreedhar <h4harisreedhar.s.s@gmail.com> Co-authored-by: Harisreedhar <46858047+harisreedhar@users.noreply.github.com> Co-authored-by: Christian Clauss <cclauss@me.com>
161 lines
8.3 KiB
Python
Executable File
161 lines
8.3 KiB
Python
Executable File
from typing import List, Optional, Tuple
|
|
|
|
import gradio
|
|
|
|
import facefusion.choices
|
|
from facefusion import face_masker, state_manager, wording
|
|
from facefusion.common_helper import calc_float_step, calc_int_step
|
|
from facefusion.typing import FaceMaskRegion, FaceMaskType, FaceOccluderModel, FaceParserModel
|
|
from facefusion.uis.core import register_ui_component
|
|
|
|
FACE_OCCLUDER_MODEL_DROPDOWN : Optional[gradio.Dropdown] = None
|
|
FACE_PARSER_MODEL_DROPDOWN : Optional[gradio.Dropdown] = None
|
|
FACE_MASK_TYPES_CHECKBOX_GROUP : Optional[gradio.CheckboxGroup] = None
|
|
FACE_MASK_REGIONS_CHECKBOX_GROUP : Optional[gradio.CheckboxGroup] = None
|
|
FACE_MASK_BLUR_SLIDER : Optional[gradio.Slider] = None
|
|
FACE_MASK_PADDING_TOP_SLIDER : Optional[gradio.Slider] = None
|
|
FACE_MASK_PADDING_RIGHT_SLIDER : Optional[gradio.Slider] = None
|
|
FACE_MASK_PADDING_BOTTOM_SLIDER : Optional[gradio.Slider] = None
|
|
FACE_MASK_PADDING_LEFT_SLIDER : Optional[gradio.Slider] = None
|
|
|
|
|
|
def render() -> None:
|
|
global FACE_OCCLUDER_MODEL_DROPDOWN
|
|
global FACE_PARSER_MODEL_DROPDOWN
|
|
global FACE_MASK_TYPES_CHECKBOX_GROUP
|
|
global FACE_MASK_REGIONS_CHECKBOX_GROUP
|
|
global FACE_MASK_BLUR_SLIDER
|
|
global FACE_MASK_PADDING_TOP_SLIDER
|
|
global FACE_MASK_PADDING_RIGHT_SLIDER
|
|
global FACE_MASK_PADDING_BOTTOM_SLIDER
|
|
global FACE_MASK_PADDING_LEFT_SLIDER
|
|
|
|
has_box_mask = 'box' in state_manager.get_item('face_mask_types')
|
|
has_region_mask = 'region' in state_manager.get_item('face_mask_types')
|
|
with gradio.Row():
|
|
FACE_OCCLUDER_MODEL_DROPDOWN = gradio.Dropdown(
|
|
label = wording.get('uis.face_occluder_model_dropdown'),
|
|
choices = facefusion.choices.face_occluder_models,
|
|
value = state_manager.get_item('face_occluder_model')
|
|
)
|
|
FACE_PARSER_MODEL_DROPDOWN = gradio.Dropdown(
|
|
label = wording.get('uis.face_parser_model_dropdown'),
|
|
choices = facefusion.choices.face_parser_models,
|
|
value = state_manager.get_item('face_parser_model')
|
|
)
|
|
FACE_MASK_TYPES_CHECKBOX_GROUP = gradio.CheckboxGroup(
|
|
label = wording.get('uis.face_mask_types_checkbox_group'),
|
|
choices = facefusion.choices.face_mask_types,
|
|
value = state_manager.get_item('face_mask_types')
|
|
)
|
|
FACE_MASK_REGIONS_CHECKBOX_GROUP = gradio.CheckboxGroup(
|
|
label = wording.get('uis.face_mask_regions_checkbox_group'),
|
|
choices = facefusion.choices.face_mask_regions,
|
|
value = state_manager.get_item('face_mask_regions'),
|
|
visible = has_region_mask
|
|
)
|
|
FACE_MASK_BLUR_SLIDER = gradio.Slider(
|
|
label = wording.get('uis.face_mask_blur_slider'),
|
|
step = calc_float_step(facefusion.choices.face_mask_blur_range),
|
|
minimum = facefusion.choices.face_mask_blur_range[0],
|
|
maximum = facefusion.choices.face_mask_blur_range[-1],
|
|
value = state_manager.get_item('face_mask_blur'),
|
|
visible = has_box_mask
|
|
)
|
|
with gradio.Group():
|
|
with gradio.Row():
|
|
FACE_MASK_PADDING_TOP_SLIDER = gradio.Slider(
|
|
label = wording.get('uis.face_mask_padding_top_slider'),
|
|
step = calc_int_step(facefusion.choices.face_mask_padding_range),
|
|
minimum = facefusion.choices.face_mask_padding_range[0],
|
|
maximum = facefusion.choices.face_mask_padding_range[-1],
|
|
value = state_manager.get_item('face_mask_padding')[0],
|
|
visible = has_box_mask
|
|
)
|
|
FACE_MASK_PADDING_RIGHT_SLIDER = gradio.Slider(
|
|
label = wording.get('uis.face_mask_padding_right_slider'),
|
|
step = calc_int_step(facefusion.choices.face_mask_padding_range),
|
|
minimum = facefusion.choices.face_mask_padding_range[0],
|
|
maximum = facefusion.choices.face_mask_padding_range[-1],
|
|
value = state_manager.get_item('face_mask_padding')[1],
|
|
visible = has_box_mask
|
|
)
|
|
with gradio.Row():
|
|
FACE_MASK_PADDING_BOTTOM_SLIDER = gradio.Slider(
|
|
label = wording.get('uis.face_mask_padding_bottom_slider'),
|
|
step = calc_int_step(facefusion.choices.face_mask_padding_range),
|
|
minimum = facefusion.choices.face_mask_padding_range[0],
|
|
maximum = facefusion.choices.face_mask_padding_range[-1],
|
|
value = state_manager.get_item('face_mask_padding')[2],
|
|
visible = has_box_mask
|
|
)
|
|
FACE_MASK_PADDING_LEFT_SLIDER = gradio.Slider(
|
|
label = wording.get('uis.face_mask_padding_left_slider'),
|
|
step = calc_int_step(facefusion.choices.face_mask_padding_range),
|
|
minimum = facefusion.choices.face_mask_padding_range[0],
|
|
maximum = facefusion.choices.face_mask_padding_range[-1],
|
|
value = state_manager.get_item('face_mask_padding')[3],
|
|
visible = has_box_mask
|
|
)
|
|
register_ui_component('face_occluder_model_dropdown', FACE_OCCLUDER_MODEL_DROPDOWN)
|
|
register_ui_component('face_parser_model_dropdown', FACE_PARSER_MODEL_DROPDOWN)
|
|
register_ui_component('face_mask_types_checkbox_group', FACE_MASK_TYPES_CHECKBOX_GROUP)
|
|
register_ui_component('face_mask_regions_checkbox_group', FACE_MASK_REGIONS_CHECKBOX_GROUP)
|
|
register_ui_component('face_mask_blur_slider', FACE_MASK_BLUR_SLIDER)
|
|
register_ui_component('face_mask_padding_top_slider', FACE_MASK_PADDING_TOP_SLIDER)
|
|
register_ui_component('face_mask_padding_right_slider', FACE_MASK_PADDING_RIGHT_SLIDER)
|
|
register_ui_component('face_mask_padding_bottom_slider', FACE_MASK_PADDING_BOTTOM_SLIDER)
|
|
register_ui_component('face_mask_padding_left_slider', FACE_MASK_PADDING_LEFT_SLIDER)
|
|
|
|
|
|
def listen() -> None:
|
|
FACE_OCCLUDER_MODEL_DROPDOWN.change(update_face_occluder_model, inputs = FACE_OCCLUDER_MODEL_DROPDOWN)
|
|
FACE_PARSER_MODEL_DROPDOWN.change(update_face_parser_model, inputs = FACE_PARSER_MODEL_DROPDOWN)
|
|
FACE_MASK_TYPES_CHECKBOX_GROUP.change(update_face_mask_types, inputs = FACE_MASK_TYPES_CHECKBOX_GROUP, outputs = [ FACE_MASK_TYPES_CHECKBOX_GROUP, FACE_MASK_REGIONS_CHECKBOX_GROUP, FACE_MASK_BLUR_SLIDER, FACE_MASK_PADDING_TOP_SLIDER, FACE_MASK_PADDING_RIGHT_SLIDER, FACE_MASK_PADDING_BOTTOM_SLIDER, FACE_MASK_PADDING_LEFT_SLIDER ])
|
|
FACE_MASK_REGIONS_CHECKBOX_GROUP.change(update_face_mask_regions, inputs = FACE_MASK_REGIONS_CHECKBOX_GROUP, outputs = FACE_MASK_REGIONS_CHECKBOX_GROUP)
|
|
FACE_MASK_BLUR_SLIDER.release(update_face_mask_blur, inputs = FACE_MASK_BLUR_SLIDER)
|
|
face_mask_padding_sliders = [ FACE_MASK_PADDING_TOP_SLIDER, FACE_MASK_PADDING_RIGHT_SLIDER, FACE_MASK_PADDING_BOTTOM_SLIDER, FACE_MASK_PADDING_LEFT_SLIDER ]
|
|
for face_mask_padding_slider in face_mask_padding_sliders:
|
|
face_mask_padding_slider.release(update_face_mask_padding, inputs = face_mask_padding_sliders)
|
|
|
|
|
|
def update_face_occluder_model(face_occluder_model : FaceOccluderModel) -> gradio.Dropdown:
|
|
face_masker.clear_inference_pool()
|
|
state_manager.set_item('face_occluder_model', face_occluder_model)
|
|
|
|
if face_masker.pre_check():
|
|
return gradio.Dropdown(value = state_manager.get_item('face_occluder_model'))
|
|
return gradio.Dropdown()
|
|
|
|
|
|
def update_face_parser_model(face_parser_model : FaceParserModel) -> gradio.Dropdown:
|
|
face_masker.clear_inference_pool()
|
|
state_manager.set_item('face_parser_model', face_parser_model)
|
|
|
|
if face_masker.pre_check():
|
|
return gradio.Dropdown(value = state_manager.get_item('face_parser_model'))
|
|
return gradio.Dropdown()
|
|
|
|
|
|
def update_face_mask_types(face_mask_types : List[FaceMaskType]) -> Tuple[gradio.CheckboxGroup, gradio.CheckboxGroup, gradio.Slider, gradio.Slider, gradio.Slider, gradio.Slider, gradio.Slider]:
|
|
face_mask_types = face_mask_types or facefusion.choices.face_mask_types
|
|
state_manager.set_item('face_mask_types', face_mask_types)
|
|
has_box_mask = 'box' in face_mask_types
|
|
has_region_mask = 'region' in face_mask_types
|
|
return gradio.CheckboxGroup(value = state_manager.get_item('face_mask_types')), gradio.CheckboxGroup(visible = has_region_mask), gradio.Slider(visible = has_box_mask), gradio.Slider(visible = has_box_mask), gradio.Slider(visible = has_box_mask), gradio.Slider(visible = has_box_mask), gradio.Slider(visible = has_box_mask)
|
|
|
|
|
|
def update_face_mask_regions(face_mask_regions : List[FaceMaskRegion]) -> gradio.CheckboxGroup:
|
|
face_mask_regions = face_mask_regions or facefusion.choices.face_mask_regions
|
|
state_manager.set_item('face_mask_regions', face_mask_regions)
|
|
return gradio.CheckboxGroup(value = state_manager.get_item('face_mask_regions'))
|
|
|
|
|
|
def update_face_mask_blur(face_mask_blur : float) -> None:
|
|
state_manager.set_item('face_mask_blur', face_mask_blur)
|
|
|
|
|
|
def update_face_mask_padding(face_mask_padding_top : float, face_mask_padding_right : float, face_mask_padding_bottom : float, face_mask_padding_left : float) -> None:
|
|
face_mask_padding = (int(face_mask_padding_top), int(face_mask_padding_right), int(face_mask_padding_bottom), int(face_mask_padding_left))
|
|
state_manager.set_item('face_mask_padding', face_mask_padding)
|