Removing Real-time JavaScript in HTML Conversion Causes Loss of Dynamic Data

[lazur07]

Description:
Markitdown's HTML converter wraps Markdownify, which removes all JavaScript and style blocks, including those responsible for loading real-time data. This issue affects documents requiring real-time data (e.g., live feeds, dynamic updates) that no longer appear in the HTML after conversion.

def convert(self, file_stream: BinaryIO, stream_info: StreamInfo, **kwargs: Any) -> DocumentConverterResult:
    encoding = "utf-8" if stream_info.charset is None else stream_info.charset
    soup = BeautifulSoup(file_stream, "html.parser", from_encoding=encoding)

    # Remove javascript and style blocks
    for script in soup(["script", "style"]):
        script.extract()

Steps to Reproduce:

1. Convert an HTML document containing JavaScript that loads real-time data (e.g., live updates or dynamic content).
2. Observe that the real-time data is missing in the converted HTML output.

Expected Behavior:
The HTML converter should:

• Preserve JavaScript responsible for fetching or displaying real-time data.
• Allow configuration to selectively retain or remove JavaScript to prevent stripping dynamic content.