You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.

141 lines
4.9 KiB

Switch codebase to use sanitized_Request instead of compat_urllib_request.Request [downloader/dash] Use sanitized_Request [downloader/http] Use sanitized_Request [atresplayer] Use sanitized_Request [bambuser] Use sanitized_Request [bliptv] Use sanitized_Request [brightcove] Use sanitized_Request [cbs] Use sanitized_Request [ceskatelevize] Use sanitized_Request [collegerama] Use sanitized_Request [extractor/common] Use sanitized_Request [crunchyroll] Use sanitized_Request [dailymotion] Use sanitized_Request [dcn] Use sanitized_Request [dramafever] Use sanitized_Request [dumpert] Use sanitized_Request [eitb] Use sanitized_Request [escapist] Use sanitized_Request [everyonesmixtape] Use sanitized_Request [extremetube] Use sanitized_Request [facebook] Use sanitized_Request [fc2] Use sanitized_Request [flickr] Use sanitized_Request [4tube] Use sanitized_Request [gdcvault] Use sanitized_Request [extractor/generic] Use sanitized_Request [hearthisat] Use sanitized_Request [hotnewhiphop] Use sanitized_Request [hypem] Use sanitized_Request [iprima] Use sanitized_Request [ivi] Use sanitized_Request [keezmovies] Use sanitized_Request [letv] Use sanitized_Request [lynda] Use sanitized_Request [metacafe] Use sanitized_Request [minhateca] Use sanitized_Request [miomio] Use sanitized_Request [meovideo] Use sanitized_Request [mofosex] Use sanitized_Request [moniker] Use sanitized_Request [mooshare] Use sanitized_Request [movieclips] Use sanitized_Request [mtv] Use sanitized_Request [myvideo] Use sanitized_Request [neteasemusic] Use sanitized_Request [nfb] Use sanitized_Request [niconico] Use sanitized_Request [noco] Use sanitized_Request [nosvideo] Use sanitized_Request [novamov] Use sanitized_Request [nowness] Use sanitized_Request [nuvid] Use sanitized_Request [played] Use sanitized_Request [pluralsight] Use sanitized_Request [pornhub] Use sanitized_Request [pornotube] Use sanitized_Request [primesharetv] Use sanitized_Request [promptfile] Use sanitized_Request [qqmusic] Use sanitized_Request [rtve] Use sanitized_Request [safari] Use sanitized_Request [sandia] Use sanitized_Request [shared] Use sanitized_Request [sharesix] Use sanitized_Request [sina] Use sanitized_Request [smotri] Use sanitized_Request [sohu] Use sanitized_Request [spankwire] Use sanitized_Request [sportdeutschland] Use sanitized_Request [streamcloud] Use sanitized_Request [streamcz] Use sanitized_Request [tapely] Use sanitized_Request [tube8] Use sanitized_Request [tubitv] Use sanitized_Request [twitch] Use sanitized_Request [twitter] Use sanitized_Request [udemy] Use sanitized_Request [vbox7] Use sanitized_Request [veoh] Use sanitized_Request [vessel] Use sanitized_Request [vevo] Use sanitized_Request [viddler] Use sanitized_Request [videomega] Use sanitized_Request [viewvster] Use sanitized_Request [viki] Use sanitized_Request [vk] Use sanitized_Request [vodlocker] Use sanitized_Request [voicerepublic] Use sanitized_Request [wistia] Use sanitized_Request [xfileshare] Use sanitized_Request [xtube] Use sanitized_Request [xvideos] Use sanitized_Request [yandexmusic] Use sanitized_Request [youku] Use sanitized_Request [youporn] Use sanitized_Request [youtube] Use sanitized_Request [patreon] Use sanitized_Request [extractor/common] Remove unused import [nfb] PEP 8
9 years ago
Switch codebase to use sanitized_Request instead of compat_urllib_request.Request [downloader/dash] Use sanitized_Request [downloader/http] Use sanitized_Request [atresplayer] Use sanitized_Request [bambuser] Use sanitized_Request [bliptv] Use sanitized_Request [brightcove] Use sanitized_Request [cbs] Use sanitized_Request [ceskatelevize] Use sanitized_Request [collegerama] Use sanitized_Request [extractor/common] Use sanitized_Request [crunchyroll] Use sanitized_Request [dailymotion] Use sanitized_Request [dcn] Use sanitized_Request [dramafever] Use sanitized_Request [dumpert] Use sanitized_Request [eitb] Use sanitized_Request [escapist] Use sanitized_Request [everyonesmixtape] Use sanitized_Request [extremetube] Use sanitized_Request [facebook] Use sanitized_Request [fc2] Use sanitized_Request [flickr] Use sanitized_Request [4tube] Use sanitized_Request [gdcvault] Use sanitized_Request [extractor/generic] Use sanitized_Request [hearthisat] Use sanitized_Request [hotnewhiphop] Use sanitized_Request [hypem] Use sanitized_Request [iprima] Use sanitized_Request [ivi] Use sanitized_Request [keezmovies] Use sanitized_Request [letv] Use sanitized_Request [lynda] Use sanitized_Request [metacafe] Use sanitized_Request [minhateca] Use sanitized_Request [miomio] Use sanitized_Request [meovideo] Use sanitized_Request [mofosex] Use sanitized_Request [moniker] Use sanitized_Request [mooshare] Use sanitized_Request [movieclips] Use sanitized_Request [mtv] Use sanitized_Request [myvideo] Use sanitized_Request [neteasemusic] Use sanitized_Request [nfb] Use sanitized_Request [niconico] Use sanitized_Request [noco] Use sanitized_Request [nosvideo] Use sanitized_Request [novamov] Use sanitized_Request [nowness] Use sanitized_Request [nuvid] Use sanitized_Request [played] Use sanitized_Request [pluralsight] Use sanitized_Request [pornhub] Use sanitized_Request [pornotube] Use sanitized_Request [primesharetv] Use sanitized_Request [promptfile] Use sanitized_Request [qqmusic] Use sanitized_Request [rtve] Use sanitized_Request [safari] Use sanitized_Request [sandia] Use sanitized_Request [shared] Use sanitized_Request [sharesix] Use sanitized_Request [sina] Use sanitized_Request [smotri] Use sanitized_Request [sohu] Use sanitized_Request [spankwire] Use sanitized_Request [sportdeutschland] Use sanitized_Request [streamcloud] Use sanitized_Request [streamcz] Use sanitized_Request [tapely] Use sanitized_Request [tube8] Use sanitized_Request [tubitv] Use sanitized_Request [twitch] Use sanitized_Request [twitter] Use sanitized_Request [udemy] Use sanitized_Request [vbox7] Use sanitized_Request [veoh] Use sanitized_Request [vessel] Use sanitized_Request [vevo] Use sanitized_Request [viddler] Use sanitized_Request [videomega] Use sanitized_Request [viewvster] Use sanitized_Request [viki] Use sanitized_Request [vk] Use sanitized_Request [vodlocker] Use sanitized_Request [voicerepublic] Use sanitized_Request [wistia] Use sanitized_Request [xfileshare] Use sanitized_Request [xtube] Use sanitized_Request [xvideos] Use sanitized_Request [yandexmusic] Use sanitized_Request [youku] Use sanitized_Request [youporn] Use sanitized_Request [youtube] Use sanitized_Request [patreon] Use sanitized_Request [extractor/common] Remove unused import [nfb] PEP 8
9 years ago
  1. # coding: utf-8
  2. from __future__ import unicode_literals
  3. import random
  4. from .common import InfoExtractor
  5. from ..compat import compat_urlparse
  6. from ..utils import (
  7. xpath_text,
  8. int_or_none,
  9. ExtractorError,
  10. sanitized_Request,
  11. )
  12. class MioMioIE(InfoExtractor):
  13. IE_NAME = 'miomio.tv'
  14. _VALID_URL = r'https?://(?:www\.)?miomio\.tv/watch/cc(?P<id>[0-9]+)'
  15. _TESTS = [{
  16. # "type=video" in flashvars
  17. 'url': 'http://www.miomio.tv/watch/cc88912/',
  18. 'info_dict': {
  19. 'id': '88912',
  20. 'ext': 'flv',
  21. 'title': '【SKY】字幕 铠武昭和VS平成 假面骑士大战FEAT战队 魔星字幕组 字幕',
  22. 'duration': 5923,
  23. },
  24. 'skip': 'Unable to load videos',
  25. }, {
  26. 'url': 'http://www.miomio.tv/watch/cc184024/',
  27. 'info_dict': {
  28. 'id': '43729',
  29. 'title': '《动漫同人插画绘制》',
  30. },
  31. 'playlist_mincount': 86,
  32. 'skip': 'Unable to load videos',
  33. }, {
  34. 'url': 'http://www.miomio.tv/watch/cc173113/',
  35. 'info_dict': {
  36. 'id': '173113',
  37. 'title': 'The New Macbook 2015 上手试玩与简评'
  38. },
  39. 'playlist_mincount': 2,
  40. 'skip': 'Unable to load videos',
  41. }, {
  42. # new 'h5' player
  43. 'url': 'http://www.miomio.tv/watch/cc273997/',
  44. 'md5': '0b27a4b4495055d826813f8c3a6b2070',
  45. 'info_dict': {
  46. 'id': '273997',
  47. 'ext': 'mp4',
  48. 'title': 'マツコの知らない世界【劇的進化SP!ビニール傘&冷凍食品2016】 1_2 - 16 05 31',
  49. },
  50. 'skip': 'Unable to load videos',
  51. }]
  52. def _extract_mioplayer(self, webpage, video_id, title, http_headers):
  53. xml_config = self._search_regex(
  54. r'flashvars="type=(?:sina|video)&amp;(.+?)&amp;',
  55. webpage, 'xml config')
  56. # skipping the following page causes lags and eventually connection drop-outs
  57. self._request_webpage(
  58. 'http://www.miomio.tv/mioplayer/mioplayerconfigfiles/xml.php?id=%s&r=%s' % (id, random.randint(100, 999)),
  59. video_id)
  60. vid_config_request = sanitized_Request(
  61. 'http://www.miomio.tv/mioplayer/mioplayerconfigfiles/sina.php?{0}'.format(xml_config),
  62. headers=http_headers)
  63. # the following xml contains the actual configuration information on the video file(s)
  64. vid_config = self._download_xml(vid_config_request, video_id)
  65. if not int_or_none(xpath_text(vid_config, 'timelength')):
  66. raise ExtractorError('Unable to load videos!', expected=True)
  67. entries = []
  68. for f in vid_config.findall('./durl'):
  69. segment_url = xpath_text(f, 'url', 'video url')
  70. if not segment_url:
  71. continue
  72. order = xpath_text(f, 'order', 'order')
  73. segment_id = video_id
  74. segment_title = title
  75. if order:
  76. segment_id += '-%s' % order
  77. segment_title += ' part %s' % order
  78. entries.append({
  79. 'id': segment_id,
  80. 'url': segment_url,
  81. 'title': segment_title,
  82. 'duration': int_or_none(xpath_text(f, 'length', 'duration'), 1000),
  83. 'http_headers': http_headers,
  84. })
  85. return entries
  86. def _download_chinese_webpage(self, *args, **kwargs):
  87. # Requests with English locales return garbage
  88. headers = {
  89. 'Accept-Language': 'zh-TW,en-US;q=0.7,en;q=0.3',
  90. }
  91. kwargs.setdefault('headers', {}).update(headers)
  92. return self._download_webpage(*args, **kwargs)
  93. def _real_extract(self, url):
  94. video_id = self._match_id(url)
  95. webpage = self._download_chinese_webpage(
  96. url, video_id)
  97. title = self._html_search_meta(
  98. 'description', webpage, 'title', fatal=True)
  99. mioplayer_path = self._search_regex(
  100. r'src="(/mioplayer(?:_h5)?/[^"]+)"', webpage, 'ref_path')
  101. if '_h5' in mioplayer_path:
  102. player_url = compat_urlparse.urljoin(url, mioplayer_path)
  103. player_webpage = self._download_chinese_webpage(
  104. player_url, video_id,
  105. note='Downloading player webpage', headers={'Referer': url})
  106. entries = self._parse_html5_media_entries(player_url, player_webpage, video_id)
  107. http_headers = {'Referer': player_url}
  108. else:
  109. http_headers = {'Referer': 'http://www.miomio.tv%s' % mioplayer_path}
  110. entries = self._extract_mioplayer(webpage, video_id, title, http_headers)
  111. if len(entries) == 1:
  112. segment = entries[0]
  113. segment['id'] = video_id
  114. segment['title'] = title
  115. segment['http_headers'] = http_headers
  116. return segment
  117. return {
  118. '_type': 'multi_video',
  119. 'id': video_id,
  120. 'entries': entries,
  121. 'title': title,
  122. 'http_headers': http_headers,
  123. }