HTTP下载文件

有些网站的文件,使用程序进行下载,需要注意header。下面是一个例子。

如果不加入下面2行,就无法下载。很多网站是通过Referer防止盗链的。

req.Host = "hldqrcode1.oss-cn-shanghai.aliyuncs.com";

req.Referer = "https://www.ecustpress.cn/";

cs 复制代码
      public static string HttpProc_sessionid(string url, string fn,  ref string err)
        {
            err = "";
            try
            {
                HttpWebRequest req = (HttpWebRequest)HttpWebRequest.Create(url);
                req.Timeout = 1000 * 30;
                req.Method = "GET";
                req.AllowAutoRedirect = true;
                req.Accept = "text/html,application/xhtml+xml,application/xml;q=0.9,image/webp,image/apng,*/*;q=0.8,application/signed-exchange;v=b3;q=0.9";
                req.Headers.Add("Accept-Encoding", "identity;q=1, *;q=0");
                req.Headers.Add("Accept-Language", "zh-CN,zh;q=0.9");
                req.Headers.Add("Cache-Control", "max-age=0");
                req.KeepAlive = true; 
                req.Host = "hldqrcode1.oss-cn-shanghai.aliyuncs.com";
                // req.Headers.Add("Range", "bytes=0-");
                req.Referer = "https://www.ecustpress.cn/";
                req.Headers.Add("Sec-Fetch-Dest", "document");
                req.Headers.Add("Sec-Fetch-Mode", "navigate");
                req.Headers.Add("Sec-Fetch-Site", "none");
                req.Headers.Add("Sec-Fetch-User", "?1");
                req.Headers.Add("Upgrade-Insecure-Requests", "1");
                req.UserAgent = "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/103.0.5060.114 Safari/537.36 Edg/103.0.1264.62";
                req.Headers.Add("sec-ch-ua", @""".Not/A)Brand"";v=""99"", ""Microsoft Edge"";v=""103"", ""Chromium"";v=""103""");
                req.Headers.Add("sec-ch-ua-mobile", "?0");
                req.Headers.Add("sec-ch-ua-platform", @"""Windows""");
                req.ProtocolVersion = HttpVersion.Version11;
                req.CookieContainer = new CookieContainer();


                //Cookie c1 = new Cookie("PHPSESSID",
                //sessionid, "/", req.Host);
                //req.CookieContainer.Add(c1);

                using (WebResponse wr = req.GetResponse())
                {
                    MemoryStream ms = new MemoryStream();
                    wr.GetResponseStream().CopyTo(ms);
                    System.IO.File.WriteAllBytes(fn, ms.ToArray());
                    return fn;
                }
            }
            catch (Exception e)
            {

                err = e.Message;
                return "";
            }

        }

对于HTTPS,还需要响应证书的检查。

public static bool inited = init();

public static bool init()

{

X509Certificate certificate = new X509Certificate();

ServicePointManager.ServerCertificateValidationCallback = new RemoteCertificateValidationCallback(CheckValidationResult);

System.Net.ServicePointManager.DefaultConnectionLimit = 512;

return true;

}

private static bool CheckValidationResult(object sender, X509Certificate certificate, X509Chain chain, SslPolicyErrors errors)

{

return true;

}

cs 复制代码
        public static bool inited = init();
        public static bool init()
        {
            X509Certificate certificate = new X509Certificate();
            ServicePointManager.ServerCertificateValidationCallback = new RemoteCertificateValidationCallback(CheckValidationResult);

            System.Net.ServicePointManager.DefaultConnectionLimit = 512;
            return true;
        }
        private static bool CheckValidationResult(object sender, X509Certificate certificate, X509Chain chain, SslPolicyErrors errors)
        {
            return true;
        }
相关推荐
游戏开发爱好者81 小时前
iOS重构期调试实战:架构升级中的性能与数据保障策略
websocket·网络协议·tcp/ip·http·网络安全·https·udp
(:满天星:)5 小时前
第31篇:块设备与字符设备管理深度解析(基于OpenEuler 24.03)
linux·运维·服务器·网络·centos
野蛮人6号6 小时前
虚拟机网络编译器还原默认设置后VMnet8和VMnet1消失了
网络·vmware·虚拟机网络编译器·vmnet8消失
scuter_yu7 小时前
主流零信任安全产品深度介绍
运维·网络·安全
江苏思维驱动智能研究院有限公司7 小时前
Sophos 网络安全:全球领先的自适应安全解决方案提供商
网络·安全·web安全
面朝大海,春不暖,花不开7 小时前
Java网络编程:TCP/UDP套接字通信详解
java·网络·tcp/ip
ChicagoTypewriter8 小时前
计算机网络中的常用表项梳理
网络·计算机网络·智能路由器
DemonAvenger8 小时前
高性能 TCP 服务器的 Go 语言实现技巧:从原理到实践
网络协议·架构·go
江山如画,佳人北望9 小时前
C#程序入门
开发语言·windows·c#
与火星的孩子对话10 小时前
Unity进阶课程【六】Android、ios、Pad 终端设备打包局域网IP调试、USB调试、性能检测、控制台打印日志等、C#
android·unity·ios·c#·ip